Max level shown:
1 [ Nov 28 04:49:47 Enabled. ]
2 [ Nov 28 04:49:47 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 28 04:49:47 Method "start" exited with status 0. ]
4 [ Nov 28 04:49:47 Rereading configuration. ]
5 [ Nov 28 04:49:47 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-28T04:49:47.810ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-28T04:49:47.810ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-28T04:49:47.861ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-28T04:49:47.861ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-28T04:49:47.976ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-28T04:49:47.985ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-28T04:49:47.993ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-28T04:49:48.596ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-28T04:49:48.735ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-28T04:49:48.735ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-28T04:49:48.735ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-28T04:49:48.735ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-28T04:49:48.735ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-11-28T04:49:48.735ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-11-28T04:49:48.738ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-28T04:49:48.738ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-28T04:49:48.738ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-28T04:49:48.738ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-28T04:49:48.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-28T04:49:48.738ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-28T04:49:48.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-28T04:49:48.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-28T04:49:48.738ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-28T04:49:48.750ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-28T04:49:48.750ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool)
322024-11-28T04:49:48.848ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal }
332024-11-28T04:49:49.317ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-28T04:49:49.317ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-28T04:49:49.317ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-28T04:49:49.317ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-28T04:49:49.317ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-28T04:49:49.317ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-28T04:49:49.317ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-28T04:49:49.326ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-28T04:49:49.326ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool)
422024-11-28T04:49:49.421ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal }
432024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-28T04:49:49.906ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-11-28T04:49:49.906ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-28T04:49:49.906ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-28T04:49:49.906ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-28T04:49:49.906ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-28T04:49:49.906ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-28T04:49:49.906ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-28T04:49:49.907ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-28T04:49:49.907ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-28T04:49:49.907ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-28T04:49:49.907ZINFOSledAgent (bootstore): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-28T04:49:49.907ZINFOSledAgent (bootstore): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-28T04:49:49.907ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-28T04:49:49.907ZINFOSledAgent (bootstore): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-28T04:49:49.907ZINFOSledAgent (bootstore): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-28T04:49:49.907ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-28T04:49:49.907ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-28T04:49:49.907ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-28T04:49:49.918ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-28T04:49:49.918ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 8285, tv_nsec: 394127983 } time_to_next_cleanup = 599.999946029s
1142024-11-28T04:49:49.918ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-28T04:49:49.918ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-28T04:49:49.918ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-28T04:49:49.920ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-28T04:49:49.921ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-28T04:49:49.923ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-28T04:49:49.923ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1187
1212024-11-28T04:49:49.923ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-28T04:49:49.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-28T04:49:49.923ZINFOSledAgent (RSS): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-28T04:49:49.923ZINFOSledAgent (RSS): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-28T04:49:49.923ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1250
1262024-11-28T04:49:49.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-28T04:49:49.923ZINFOSledAgent (RSS): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-28T04:49:49.923ZINFOSledAgent (RSS): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-28T04:49:49.923ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1292
1302024-11-28T04:49:49.923ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-28T04:49:49.923ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-28T04:49:49.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-28T04:49:49.923ZINFOSledAgent (RSS): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-28T04:49:49.923ZINFOSledAgent (RSS): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-28T04:49:49.924ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e95a4636-3865-437f-b2db-2549d48485b1 (sled), rack_id: cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-28T04:49:49.924ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1326
1372024-11-28T04:49:49.924ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-28T04:49:49.924ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-28T04:49:49.924ZINFOSledAgent (bootstore): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-28T04:49:49.924ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-28T04:49:49.924ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e95a4636-3865-437f-b2db-2549d48485b1 (sled), rack_id: cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-28T04:49:49.925ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-28T04:49:49.925ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-28T04:49:49.929ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-28T04:49:49.935ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-28T04:49:49.935ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-28T04:49:49.939ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-28T04:49:49.939ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-28T04:49:49.939ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:58583
1502024-11-28T04:49:49.940ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e95a4636-3865-437f-b2db-2549d48485b1 (sled), rack_id: cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-28T04:49:49.940ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-28T04:49:49.940ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-28T04:49:49.940ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-28T04:49:49.940ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-28T04:49:49.940ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-28T04:49:49.940ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-28T04:49:49.940ZINFOSledAgent (StorageManager): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-28T04:49:49.940ZINFOSledAgent (StorageManager): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-28T04:49:49.940ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-28T04:49:49.940ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-28T04:49:49.940ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-28T04:49:49.940ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-28T04:49:49.940ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-28T04:49:49.957ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-28T04:49:49.979ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-28T04:49:49.997ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-28T04:49:50.019ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
1682024-11-28T04:49:50.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-28T04:49:50.019ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
1702024-11-28T04:49:50.019ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-28T04:49:50.023ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 105.522085ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f6499e75-ef9e-4006-97f5-a67177d96f51", "content-length": "124", "date": "Thu, 28 Nov 2024 04:49:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f6499e75-ef9e-4006-97f5-a67177d96f51" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-28T04:49:50.033ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_4804908f-0424-4e53-a3b8-3a78658ad743/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-28T04:49:50.057ZINFOSledAgent: successfully created encrypted zvol: name="oxi_4804908f-0424-4e53-a3b8-3a78658ad743/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-28T04:49:50.057ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_4804908f-0424-4e53-a3b8-3a78658ad743/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-28T04:49:50.063ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
1762024-11-28T04:49:50.063ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-28T04:49:50.063ZINFOSledAgent (BackingFs): Ensuring dataset oxi_4804908f-0424-4e53-a3b8-3a78658ad743/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-28T04:49:50.129ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-28T04:49:50.130ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 162.853483ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d54f3697-2c92-4890-920f-d4b73cd1be2b", "content-length": "124", "date": "Thu, 28 Nov 2024 04:49:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d54f3697-2c92-4890-920f-d4b73cd1be2b" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-28T04:49:50.146ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-28T04:49:50.294ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-28T04:49:50.294ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 77.344806ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "44801f64-e999-443d-9697-5a36c14984a4", "content-length": "124", "date": "Thu, 28 Nov 2024 04:49:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "44801f64-e999-443d-9697-5a36c14984a4" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-28T04:49:50.364ZINFOSledAgent (BackingFs): Mounting oxi_4804908f-0424-4e53-a3b8-3a78658ad743/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-28T04:49:50.373ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-11-28T04:49:50.373ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 197.227809ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4cc244b1-2e9d-48ba-9736-7fabaf621332", "content-length": "124", "date": "Thu, 28 Nov 2024 04:49:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4cc244b1-2e9d-48ba-9736-7fabaf621332" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-11-28T04:49:50.377ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-11-28T04:49:50.377ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-11-28T04:49:50.377ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-11-28T04:49:50.377ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-11-28T04:49:50.572ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-28T04:49:50.573ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 124.80564ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2bfe1841-87e6-41a2-97df-e9190d7d6073", "content-length": "124", "date": "Thu, 28 Nov 2024 04:49:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2bfe1841-87e6-41a2-97df-e9190d7d6073" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-28T04:49:50.699ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-28T04:49:50.700ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 330.081132ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a0f8035a-34db-4f0b-9f6b-b7bae414ac06", "content-length": "124", "date": "Thu, 28 Nov 2024 04:49:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a0f8035a-34db-4f0b-9f6b-b7bae414ac06" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-28T04:49:51.031ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-28T04:49:51.032ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 287.195866ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "25d9bad9-f338-481b-baf9-b0c524320a6e", "content-length": "124", "date": "Thu, 28 Nov 2024 04:49:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "25d9bad9-f338-481b-baf9-b0c524320a6e" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-28T04:49:51.115ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
1972024-11-28T04:49:51.121ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:57603 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
1982024-11-28T04:49:51.121ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
1992024-11-28T04:49:51.121ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:57603 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = e95a4636-3865-437f-b2db-2549d48485b1 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2002024-11-28T04:49:51.122ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 274.716059ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2012024-11-28T04:49:51.123ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2022024-11-28T04:49:51.123ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2032024-11-28T04:49:51.123ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2042024-11-28T04:49:51.123ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-28T04:49:51.320ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-28T04:49:51.398ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 637.101893ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2072024-11-28T04:49:52.036ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 959.198604ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2082024-11-28T04:49:52.997ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.260543933s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2092024-11-28T04:49:53.721ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2102024-11-28T04:49:53.721ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2112024-11-28T04:49:53.721ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2122024-11-28T04:49:53.721ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2132024-11-28T04:49:53.721ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2142024-11-28T04:49:53.721ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2152024-11-28T04:49:53.723ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2162024-11-28T04:49:53.724ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2172024-11-28T04:49:53.724ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='99548f68-26c9-4d59-90ab-ca207c10b740'/> <propval type="astring" name="rack_id" value='cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe9c:6f27'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632'/> <propval type="astring" name="sled_id" value='e95a4636-3865-437f-b2db-2549d48485b1'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='e95a4636-3865-437f-b2db-2549d48485b1'/> <propval type="astring" name="rack_uuid" value='cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='e95a4636-3865-437f-b2db-2549d48485b1'/> <propval type="astring" name="rack_uuid" value='cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-28T04:49:53.725ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-28T04:49:54.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 37.267515ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-28T04:49:54.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 65.627715ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-28T04:49:54.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 286.718296ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-28T04:49:54.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 358.51996ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-28T04:49:55.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.189691196s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-28T04:49:55.267ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.873609501s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2252024-11-28T04:49:56.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 801.264087ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-28T04:49:57.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 613.709309ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-28T04:49:57.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 854.763799ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-28T04:49:58.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.240148064s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-28T04:49:59.142ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.549314761s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2302024-11-28T04:50:00.470ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/nexus.rs:527 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2312024-11-28T04:50:00.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-11-28T04:50:00.500ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2332024-11-28T04:50:00.501ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2342024-11-28T04:50:00.502ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2352024-11-28T04:50:00.502ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-28T04:50:00.502ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-28T04:50:00.502ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2382024-11-28T04:50:00.502ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2392024-11-28T04:50:00.502ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2402024-11-28T04:50:00.502ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2412024-11-28T04:50:00.502ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:58583
2422024-11-28T04:50:00.713ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2432024-11-28T04:50:00.713ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2442024-11-28T04:50:00.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-11-28T04:50:00.714ZINFOSledAgent (RSS): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-28T04:50:00.714ZINFOSledAgent (RSS): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2472024-11-28T04:50:00.714ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-28T04:50:00.714ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-28T04:50:00.714ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-28T04:50:00.714ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-28T04:50:00.718ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2522024-11-28T04:50:00.718ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2532024-11-28T04:50:00.718ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2542024-11-28T04:50:00.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53469
2552024-11-28T04:50:00.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-28T04:50:00.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-28T04:50:00.956ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-28T04:50:00.956ZINFOSledAgent (ServiceManager): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:188
2592024-11-28T04:50:00.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53469 req_id = 021102d6-bc56-416e-98e1-41378040b206 response_code = 200 uri = /inventory
2602024-11-28T04:50:00.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37193
2612024-11-28T04:50:00.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37193 req_id = 296fed31-0ae8-46ab-9916-e928da5a456e response_code = 200 uri = /sled-role
2622024-11-28T04:50:00.989ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2632024-11-28T04:50:00.989ZINFOSledAgent (RSS): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-28T04:50:00.989ZINFOSledAgent (RSS): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2652024-11-28T04:50:00.990ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:982
2662024-11-28T04:50:01.022ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c7a6ec3d-07bc-4852-8984-a1d7a389bbbb (physical_disk), pool_id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: bb74768b-6551-45da-9da3-32bcfcbcb30b (physical_disk), pool_id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: bd395c41-878c-4929-a664-a92134d4af5a (physical_disk), pool_id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: a0f5bb7a-8aca-4b08-b47f-578236193792 (physical_disk), pool_id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 277e9e5c-ef22-4197-bab5-d680bb888c81 (physical_disk), pool_id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 48a30006-9542-41a0-a628-853ff7d7380a (physical_disk), pool_id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 50001857-003d-4588-8d9c-74cdc4a265fb (physical_disk), pool_id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3f467a16-bae0-4805-a366-8449bfd80bed (physical_disk), pool_id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 53bb6cad-6592-49d6-b15b-880294692348 (physical_disk), pool_id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:369 sled_address = [fd00:1122:3344:101::1]:12345
2672024-11-28T04:50:01.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60490
2682024-11-28T04:50:01.022ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2692024-11-28T04:50:01.022ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c7a6ec3d-07bc-4852-8984-a1d7a389bbbb (physical_disk), pool_id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: bb74768b-6551-45da-9da3-32bcfcbcb30b (physical_disk), pool_id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: bd395c41-878c-4929-a664-a92134d4af5a (physical_disk), pool_id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: a0f5bb7a-8aca-4b08-b47f-578236193792 (physical_disk), pool_id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 277e9e5c-ef22-4197-bab5-d680bb888c81 (physical_disk), pool_id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 48a30006-9542-41a0-a628-853ff7d7380a (physical_disk), pool_id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 50001857-003d-4588-8d9c-74cdc4a265fb (physical_disk), pool_id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3f467a16-bae0-4805-a366-8449bfd80bed (physical_disk), pool_id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 53bb6cad-6592-49d6-b15b-880294692348 (physical_disk), pool_id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2702024-11-28T04:50:01.022ZINFOSledAgent (StorageManager): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-28T04:50:01.022ZINFOSledAgent (StorageManager): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2722024-11-28T04:50:01.022ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2732024-11-28T04:50:01.022ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2742024-11-28T04:50:01.022ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2752024-11-28T04:50:01.022ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2762024-11-28T04:50:01.022ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2772024-11-28T04:50:01.152ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2782024-11-28T04:50:01.152ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2792024-11-28T04:50:01.158ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2802024-11-28T04:50:01.158ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4f498487-c0df-4538-adab-e17b7773b517 (zpool)
2812024-11-28T04:50:01.344ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2822024-11-28T04:50:01.440ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }
2832024-11-28T04:50:01.449ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2842024-11-28T04:50:01.449ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2852024-11-28T04:50:01.449ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2862024-11-28T04:50:01.449ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2872024-11-28T04:50:01.449ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-28T04:50:01.449ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-28T04:50:01.449ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2902024-11-28T04:50:01.486ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-11-28T04:50:01.494ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone file = sled-storage/src/dataset.rs:303
2922024-11-28T04:50:01.505ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
2932024-11-28T04:50:01.670ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4f498487-c0df-4538-adab-e17b7773b517 file = sled-storage/src/dataset.rs:389
2942024-11-28T04:50:01.678ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2952024-11-28T04:50:01.678ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2962024-11-28T04:50:01.678ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2972024-11-28T04:50:01.678ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2982024-11-28T04:50:01.678ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2992024-11-28T04:50:01.688ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3002024-11-28T04:50:01.688ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool)
3012024-11-28T04:50:01.778ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }
3022024-11-28T04:50:01.786ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3032024-11-28T04:50:01.786ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3042024-11-28T04:50:01.786ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3052024-11-28T04:50:01.786ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3062024-11-28T04:50:01.786ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-28T04:50:01.786ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-11-28T04:50:01.786ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3092024-11-28T04:50:01.821ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3102024-11-28T04:50:01.829ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone file = sled-storage/src/dataset.rs:303
3112024-11-28T04:50:02.007ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3abe6613-feef-46d1-ade9-21289cb9be78 file = sled-storage/src/dataset.rs:389
3122024-11-28T04:50:02.016ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-28T04:50:02.016ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-28T04:50:02.016ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-28T04:50:02.016ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-28T04:50:02.016ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-28T04:50:02.025ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-28T04:50:02.025ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool)
3192024-11-28T04:50:02.122ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }
3202024-11-28T04:50:02.131ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3212024-11-28T04:50:02.131ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3222024-11-28T04:50:02.131ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3232024-11-28T04:50:02.131ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3242024-11-28T04:50:02.131ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-28T04:50:02.131ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-28T04:50:02.131ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3272024-11-28T04:50:02.166ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-28T04:50:02.174ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone file = sled-storage/src/dataset.rs:303
3292024-11-28T04:50:02.350ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9 file = sled-storage/src/dataset.rs:389
3302024-11-28T04:50:02.358ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-28T04:50:02.358ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-28T04:50:02.358ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-28T04:50:02.358ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-28T04:50:02.358ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-28T04:50:02.368ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-28T04:50:02.368ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool)
3372024-11-28T04:50:02.462ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }
3382024-11-28T04:50:02.470ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3392024-11-28T04:50:02.470ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3402024-11-28T04:50:02.470ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3412024-11-28T04:50:02.470ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3422024-11-28T04:50:02.470ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-28T04:50:02.470ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-28T04:50:02.470ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3452024-11-28T04:50:02.504ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-11-28T04:50:02.507ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
3472024-11-28T04:50:02.512ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/zone file = sled-storage/src/dataset.rs:303
3482024-11-28T04:50:02.690ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf file = sled-storage/src/dataset.rs:389
3492024-11-28T04:50:02.699ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3502024-11-28T04:50:02.699ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3512024-11-28T04:50:02.699ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3522024-11-28T04:50:02.699ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3532024-11-28T04:50:02.699ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3542024-11-28T04:50:02.710ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3552024-11-28T04:50:02.710ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool)
3562024-11-28T04:50:02.807ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }
3572024-11-28T04:50:02.815ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3582024-11-28T04:50:02.815ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3592024-11-28T04:50:02.815ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3602024-11-28T04:50:02.815ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3612024-11-28T04:50:02.815ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-28T04:50:02.815ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-11-28T04:50:02.815ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3642024-11-28T04:50:02.851ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-28T04:50:02.859ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone file = sled-storage/src/dataset.rs:303
3662024-11-28T04:50:03.037ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c1ab70e5-120b-4db1-895c-564a6858dda1 file = sled-storage/src/dataset.rs:389
3672024-11-28T04:50:03.045ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-28T04:50:03.045ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-28T04:50:03.045ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-28T04:50:03.045ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-28T04:50:03.045ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-28T04:50:03.055ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-28T04:50:03.055ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool)
3742024-11-28T04:50:03.147ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }
3752024-11-28T04:50:03.155ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3762024-11-28T04:50:03.155ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3772024-11-28T04:50:03.155ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3782024-11-28T04:50:03.155ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3792024-11-28T04:50:03.155ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-28T04:50:03.155ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-28T04:50:03.155ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3822024-11-28T04:50:03.191ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-28T04:50:03.199ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc/crypt/zone file = sled-storage/src/dataset.rs:303
3842024-11-28T04:50:03.372ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc file = sled-storage/src/dataset.rs:389
3852024-11-28T04:50:03.380ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-28T04:50:03.380ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-28T04:50:03.380ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-28T04:50:03.380ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-28T04:50:03.380ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-28T04:50:03.390ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-28T04:50:03.390ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool)
3922024-11-28T04:50:03.485ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }
3932024-11-28T04:50:03.494ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3942024-11-28T04:50:03.494ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3952024-11-28T04:50:03.494ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3962024-11-28T04:50:03.495ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3972024-11-28T04:50:03.495ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-28T04:50:03.495ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-28T04:50:03.495ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4002024-11-28T04:50:03.509ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4012024-11-28T04:50:03.531ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4022024-11-28T04:50:03.542ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/zone file = sled-storage/src/dataset.rs:303
4032024-11-28T04:50:03.721ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad file = sled-storage/src/dataset.rs:389
4042024-11-28T04:50:03.729ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4052024-11-28T04:50:03.729ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4062024-11-28T04:50:03.729ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4072024-11-28T04:50:03.729ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082024-11-28T04:50:03.729ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4092024-11-28T04:50:03.739ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4102024-11-28T04:50:03.739ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool)
4112024-11-28T04:50:03.848ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }
4122024-11-28T04:50:03.856ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4132024-11-28T04:50:03.856ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4142024-11-28T04:50:03.856ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4152024-11-28T04:50:03.856ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4162024-11-28T04:50:03.856ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-28T04:50:03.856ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-11-28T04:50:03.856ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4192024-11-28T04:50:03.892ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-28T04:50:03.900ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/zone file = sled-storage/src/dataset.rs:303
4212024-11-28T04:50:04.078ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b file = sled-storage/src/dataset.rs:389
4222024-11-28T04:50:04.086ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-28T04:50:04.086ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-28T04:50:04.086ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-28T04:50:04.086ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-28T04:50:04.086ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-28T04:50:04.096ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-28T04:50:04.096ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 33949fdd-4265-4f10-ab58-a876a4529485 (zpool)
4292024-11-28T04:50:04.188ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }
4302024-11-28T04:50:04.196ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4312024-11-28T04:50:04.196ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4322024-11-28T04:50:04.196ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4332024-11-28T04:50:04.196ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4342024-11-28T04:50:04.196ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-28T04:50:04.196ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-28T04:50:04.196ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4372024-11-28T04:50:04.231ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-28T04:50:04.238ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_33949fdd-4265-4f10-ab58-a876a4529485/crypt/zone file = sled-storage/src/dataset.rs:303
4392024-11-28T04:50:04.414ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_33949fdd-4265-4f10-ab58-a876a4529485 file = sled-storage/src/dataset.rs:389
4402024-11-28T04:50:04.422ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-28T04:50:04.422ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-28T04:50:04.422ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-28T04:50:04.422ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4804908f-0424-4e53-a3b8-3a78658ad743 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56650285-0e45-49ec-ab47-9b356ce5dd77 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-28T04:50:04.422ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-28T04:50:04.422ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-28T04:50:04.422ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-28T04:50:04.422ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4482024-11-28T04:50:04.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4492024-11-28T04:50:04.422ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4502024-11-28T04:50:04.422ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4512024-11-28T04:50:04.422ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4522024-11-28T04:50:04.422ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4532024-11-28T04:50:04.422ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4542024-11-28T04:50:04.423ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4552024-11-28T04:50:04.423ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4562024-11-28T04:50:04.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3400789 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60490 req_id = b7c43a4a-a52d-4704-9ed7-f9ac041cf4d6 response_code = 200 uri = /omicron-physical-disks
4572024-11-28T04:50:04.454ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0355f4e2-8686-4119-9208-eddb95a60433 (dataset): DatasetConfig { id: 0355f4e2-8686-4119-9208-eddb95a60433 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 046ae919-3d96-4e17-91bc-cb79589b7b1c (dataset): DatasetConfig { id: 046ae919-3d96-4e17-91bc-cb79589b7b1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 050fc6db-ce70-4225-a9e5-e5b1232b0b9e (dataset): DatasetConfig { id: 050fc6db-ce70-4225-a9e5-e5b1232b0b9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0627ee41-e031-44db-9258-811b58f5ccc0 (dataset): DatasetConfig { id: 0627ee41-e031-44db-9258-811b58f5ccc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 100ae049-0f5b-4dd9-a014-a113426daed3 (dataset): DatasetConfig { id: 100ae049-0f5b-4dd9-a014-a113426daed3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11f3ece7-fee7-4883-955c-7bc204eef371 (dataset): DatasetConfig { id: 11f3ece7-fee7-4883-955c-7bc204eef371 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1241331f-6f56-4aeb-810a-baac6fd4475a (dataset): DatasetConfig { id: 1241331f-6f56-4aeb-810a-baac6fd4475a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12cf5970-536d-4bca-9542-63f2ca332e13 (dataset): DatasetConfig { id: 12cf5970-536d-4bca-9542-63f2ca332e13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13b83ce9-5786-429f-995a-295f6f16efa4 (dataset): DatasetConfig { id: 13b83ce9-5786-429f-995a-295f6f16efa4 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15ce5fbb-b6e4-453f-b0c9-ed95b8d7e8d5 (dataset): DatasetConfig { id: 15ce5fbb-b6e4-453f-b0c9-ed95b8d7e8d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1b711c1a-6686-44d3-b14e-14e5d6b615b6 (dataset): DatasetConfig { id: 1b711c1a-6686-44d3-b14e-14e5d6b615b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2627918d-dded-48f5-a439-e67bc18bef58 (dataset): DatasetConfig { id: 2627918d-dded-48f5-a439-e67bc18bef58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29d12987-5714-4048-86f6-7a9f7f91359d (dataset): DatasetConfig { id: 29d12987-5714-4048-86f6-7a9f7f91359d (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2cb0275a-a55b-48b0-9446-4e5887ac38bc (dataset): DatasetConfig { id: 2cb0275a-a55b-48b0-9446-4e5887ac38bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31509e76-1359-45ea-a32e-4e7132d599fa (dataset): DatasetConfig { id: 31509e76-1359-45ea-a32e-4e7132d599fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36428fd7-4760-40b0-beda-4dc9865c9084 (dataset): DatasetConfig { id: 36428fd7-4760-40b0-beda-4dc9865c9084 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 364c92a3-45f1-494c-a1e3-0462196cb985 (dataset): DatasetConfig { id: 364c92a3-45f1-494c-a1e3-0462196cb985 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3762c02c-dea4-40e9-9b12-f6fb84d42568 (dataset): DatasetConfig { id: 3762c02c-dea4-40e9-9b12-f6fb84d42568 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 39b9ebab-f71e-4e21-af37-51baca3a23d8 (dataset): DatasetConfig { id: 39b9ebab-f71e-4e21-af37-51baca3a23d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ecfae09-46a0-4c32-9e56-0804d0b9b9e5 (dataset): DatasetConfig { id: 3ecfae09-46a0-4c32-9e56-0804d0b9b9e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 412de724-9af6-4dd0-97eb-110ea1fd0563 (dataset): DatasetConfig { id: 412de724-9af6-4dd0-97eb-110ea1fd0563 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4495bf3d-dd8a-4081-bb87-bb738f875363 (dataset): DatasetConfig { id: 4495bf3d-dd8a-4081-bb87-bb738f875363 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45f8b51d-3018-433b-8bb8-048445ed8da6 (dataset): DatasetConfig { id: 45f8b51d-3018-433b-8bb8-048445ed8da6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d80f882-e913-456a-a7a0-198342c44913 (dataset): DatasetConfig { id: 4d80f882-e913-456a-a7a0-198342c44913 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5555c1c1-2a23-4624-9c60-7f551a50e380 (dataset): DatasetConfig { id: 5555c1c1-2a23-4624-9c60-7f551a50e380 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 564341a1-c981-4d96-ba2a-1f1185f0f3dd (dataset): DatasetConfig { id: 564341a1-c981-4d96-ba2a-1f1185f0f3dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58cc5c18-93c0-4abe-8579-1e39c466165a (dataset): DatasetConfig { id: 58cc5c18-93c0-4abe-8579-1e39c466165a (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cb18694-471e-404a-b6fc-e2be5652cea3 (dataset): DatasetConfig { id: 5cb18694-471e-404a-b6fc-e2be5652cea3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60f8e1c6-66c1-4e31-99f9-f8f304093302 (dataset): DatasetConfig { id: 60f8e1c6-66c1-4e31-99f9-f8f304093302 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 620034c1-2721-460b-bd95-6930af74ff21 (dataset): DatasetConfig { id: 620034c1-2721-460b-bd95-6930af74ff21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64af12e1-0979-4543-8cf7-9c0d0aed8a33 (dataset): DatasetConfig { id: 64af12e1-0979-4543-8cf7-9c0d0aed8a33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a0186ff-dc22-4278-8479-6638e1cb44f1 (dataset): DatasetConfig { id: 6a0186ff-dc22-4278-8479-6638e1cb44f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75db961e-c7e1-4ca0-b1a9-2f7d36f6b36f (dataset): DatasetConfig { id: 75db961e-c7e1-4ca0-b1a9-2f7d36f6b36f (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 797e95ae-a5d8-4190-93ea-3a7876b3d2f0 (dataset): DatasetConfig { id: 797e95ae-a5d8-4190-93ea-3a7876b3d2f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a447fe3-4701-4d25-b1bd-f292867a57f8 (dataset): DatasetConfig { id: 7a447fe3-4701-4d25-b1bd-f292867a57f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8049255d-b801-42e2-b4da-7fd1e3eedc13 (dataset): DatasetConfig { id: 8049255d-b801-42e2-b4da-7fd1e3eedc13 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83ff934a-222a-4997-a027-24d8c2a547cf (dataset): DatasetConfig { id: 83ff934a-222a-4997-a027-24d8c2a547cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ba16254-8462-40e1-a8bd-e3c903241d56 (dataset): DatasetConfig { id: 8ba16254-8462-40e1-a8bd-e3c903241d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ea84284-65b8-4be9-b254-8cb008601f4e (dataset): DatasetConfig { id: 8ea84284-65b8-4be9-b254-8cb008601f4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8eeb87f5-a12e-437a-8ab0-832881d6366f (dataset): DatasetConfig { id: 8eeb87f5-a12e-437a-8ab0-832881d6366f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9459d716-9000-4650-ad75-0fc321fd9270 (dataset): DatasetConfig { id: 9459d716-9000-4650-ad75-0fc321fd9270 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96b96883-4ff1-4e9d-88d7-a5627b9f6057 (dataset): DatasetConfig { id: 96b96883-4ff1-4e9d-88d7-a5627b9f6057 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99cfe21f-4503-4e26-a3d5-86514183f83b (dataset): DatasetConfig { id: 99cfe21f-4503-4e26-a3d5-86514183f83b (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9f2fccbd-409c-40e4-8180-df286712eb03 (dataset): DatasetConfig { id: 9f2fccbd-409c-40e4-8180-df286712eb03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a213544a-5d95-46b0-ac92-fa0c65e73844 (dataset): DatasetConfig { id: a213544a-5d95-46b0-ac92-fa0c65e73844 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3d64a30-e3e2-499a-8bf1-b5464055a878 (dataset): DatasetConfig { id: a3d64a30-e3e2-499a-8bf1-b5464055a878 (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5b791cd-94cd-45be-a895-4cdf9e597aec (dataset): DatasetConfig { id: a5b791cd-94cd-45be-a895-4cdf9e597aec (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab1b99a9-bc12-4758-86d9-db693e846d3a (dataset): DatasetConfig { id: ab1b99a9-bc12-4758-86d9-db693e846d3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b59aa2d9-8862-4bc8-ba5b-4bb3d7099a7e (dataset): DatasetConfig { id: b59aa2d9-8862-4bc8-ba5b-4bb3d7099a7e (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b96c8f3f-ed4b-4802-a9e1-63babdc9f78f (dataset): DatasetConfig { id: b96c8f3f-ed4b-4802-a9e1-63babdc9f78f (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baaacf76-cd9b-4c28-94b3-6da016d08b25 (dataset): DatasetConfig { id: baaacf76-cd9b-4c28-94b3-6da016d08b25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, badbbba3-6b9b-41dc-b002-d42902151d16 (dataset): DatasetConfig { id: badbbba3-6b9b-41dc-b002-d42902151d16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd3664c5-bf4a-472c-b689-0c537d3b88b7 (dataset): DatasetConfig { id: bd3664c5-bf4a-472c-b689-0c537d3b88b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c198195c-f0b8-4e97-b6d4-a630c016eb55 (dataset): DatasetConfig { id: c198195c-f0b8-4e97-b6d4-a630c016eb55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cafed41d-6ec2-40e5-beb8-3825acd5fb79 (dataset): DatasetConfig { id: cafed41d-6ec2-40e5-beb8-3825acd5fb79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf83ca22-0705-4636-956b-ac6ee87fa1fe (dataset): DatasetConfig { id: cf83ca22-0705-4636-956b-ac6ee87fa1fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0418297-eb6e-4d2b-be3c-7c478a23bc85 (dataset): DatasetConfig { id: d0418297-eb6e-4d2b-be3c-7c478a23bc85 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0696982-4014-4c62-963d-3222f01f20b2 (dataset): DatasetConfig { id: d0696982-4014-4c62-963d-3222f01f20b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dd34bfde-2fbe-452e-ab64-88a76dc41fc7 (dataset): DatasetConfig { id: dd34bfde-2fbe-452e-ab64-88a76dc41fc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de68b11e-b342-49c4-b018-253284c11192 (dataset): DatasetConfig { id: de68b11e-b342-49c4-b018-253284c11192 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ea9422fd-1230-47f0-a97e-9b865f949d5b (dataset): DatasetConfig { id: ea9422fd-1230-47f0-a97e-9b865f949d5b (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efc468d0-d520-4268-b8b4-d2afd4bc079f (dataset): DatasetConfig { id: efc468d0-d520-4268-b8b4-d2afd4bc079f (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f62d202b-af47-46dc-a75a-3545c42a0cd3 (dataset): DatasetConfig { id: f62d202b-af47-46dc-a75a-3545c42a0cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f6d6a144-5951-4a16-85a6-3412d0d7a83e (dataset): DatasetConfig { id: f6d6a144-5951-4a16-85a6-3412d0d7a83e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f81499a9-b9a9-49ee-9ddb-de3aae3a272b (dataset): DatasetConfig { id: f81499a9-b9a9-49ee-9ddb-de3aae3a272b (dataset), name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fc4be75a-28d6-48d2-9e15-5e14f89d54cc (dataset): DatasetConfig { id: fc4be75a-28d6-48d2-9e15-5e14f89d54cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:444 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-28T04:50:04.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49606
4592024-11-28T04:50:04.455ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4602024-11-28T04:50:04.457ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0355f4e2-8686-4119-9208-eddb95a60433 (dataset): DatasetConfig { id: 0355f4e2-8686-4119-9208-eddb95a60433 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 046ae919-3d96-4e17-91bc-cb79589b7b1c (dataset): DatasetConfig { id: 046ae919-3d96-4e17-91bc-cb79589b7b1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 050fc6db-ce70-4225-a9e5-e5b1232b0b9e (dataset): DatasetConfig { id: 050fc6db-ce70-4225-a9e5-e5b1232b0b9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0627ee41-e031-44db-9258-811b58f5ccc0 (dataset): DatasetConfig { id: 0627ee41-e031-44db-9258-811b58f5ccc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 100ae049-0f5b-4dd9-a014-a113426daed3 (dataset): DatasetConfig { id: 100ae049-0f5b-4dd9-a014-a113426daed3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11f3ece7-fee7-4883-955c-7bc204eef371 (dataset): DatasetConfig { id: 11f3ece7-fee7-4883-955c-7bc204eef371 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1241331f-6f56-4aeb-810a-baac6fd4475a (dataset): DatasetConfig { id: 1241331f-6f56-4aeb-810a-baac6fd4475a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12cf5970-536d-4bca-9542-63f2ca332e13 (dataset): DatasetConfig { id: 12cf5970-536d-4bca-9542-63f2ca332e13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13b83ce9-5786-429f-995a-295f6f16efa4 (dataset): DatasetConfig { id: 13b83ce9-5786-429f-995a-295f6f16efa4 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15ce5fbb-b6e4-453f-b0c9-ed95b8d7e8d5 (dataset): DatasetConfig { id: 15ce5fbb-b6e4-453f-b0c9-ed95b8d7e8d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1b711c1a-6686-44d3-b14e-14e5d6b615b6 (dataset): DatasetConfig { id: 1b711c1a-6686-44d3-b14e-14e5d6b615b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2627918d-dded-48f5-a439-e67bc18bef58 (dataset): DatasetConfig { id: 2627918d-dded-48f5-a439-e67bc18bef58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29d12987-5714-4048-86f6-7a9f7f91359d (dataset): DatasetConfig { id: 29d12987-5714-4048-86f6-7a9f7f91359d (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2cb0275a-a55b-48b0-9446-4e5887ac38bc (dataset): DatasetConfig { id: 2cb0275a-a55b-48b0-9446-4e5887ac38bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31509e76-1359-45ea-a32e-4e7132d599fa (dataset): DatasetConfig { id: 31509e76-1359-45ea-a32e-4e7132d599fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36428fd7-4760-40b0-beda-4dc9865c9084 (dataset): DatasetConfig { id: 36428fd7-4760-40b0-beda-4dc9865c9084 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 364c92a3-45f1-494c-a1e3-0462196cb985 (dataset): DatasetConfig { id: 364c92a3-45f1-494c-a1e3-0462196cb985 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3762c02c-dea4-40e9-9b12-f6fb84d42568 (dataset): DatasetConfig { id: 3762c02c-dea4-40e9-9b12-f6fb84d42568 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 39b9ebab-f71e-4e21-af37-51baca3a23d8 (dataset): DatasetConfig { id: 39b9ebab-f71e-4e21-af37-51baca3a23d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ecfae09-46a0-4c32-9e56-0804d0b9b9e5 (dataset): DatasetConfig { id: 3ecfae09-46a0-4c32-9e56-0804d0b9b9e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 412de724-9af6-4dd0-97eb-110ea1fd0563 (dataset): DatasetConfig { id: 412de724-9af6-4dd0-97eb-110ea1fd0563 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4495bf3d-dd8a-4081-bb87-bb738f875363 (dataset): DatasetConfig { id: 4495bf3d-dd8a-4081-bb87-bb738f875363 (dataset), name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45f8b51d-3018-433b-8bb8-048445ed8da6 (dataset): DatasetConfig { id: 45f8b51d-3018-433b-8bb8-048445ed8da6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d80f882-e913-456a-a7a0-198342c44913 (dataset): DatasetConfig { id: 4d80f882-e913-456a-a7a0-198342c44913 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5555c1c1-2a23-4624-9c60-7f551a50e380 (dataset): DatasetConfig { id: 5555c1c1-2a23-4624-9c60-7f551a50e380 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 564341a1-c981-4d96-ba2a-1f1185f0f3dd (dataset): DatasetConfig { id: 564341a1-c981-4d96-ba2a-1f1185f0f3dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58cc5c18-93c0-4abe-8579-1e39c466165a (dataset): DatasetConfig { id: 58cc5c18-93c0-4abe-8579-1e39c466165a (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cb18694-471e-404a-b6fc-e2be5652cea3 (dataset): DatasetConfig { id: 5cb18694-471e-404a-b6fc-e2be5652cea3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60f8e1c6-66c1-4e31-99f9-f8f304093302 (dataset): DatasetConfig { id: 60f8e1c6-66c1-4e31-99f9-f8f304093302 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 620034c1-2721-460b-bd95-6930af74ff21 (dataset): DatasetConfig { id: 620034c1-2721-460b-bd95-6930af74ff21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64af12e1-0979-4543-8cf7-9c0d0aed8a33 (dataset): DatasetConfig { id: 64af12e1-0979-4543-8cf7-9c0d0aed8a33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a0186ff-dc22-4278-8479-6638e1cb44f1 (dataset): DatasetConfig { id: 6a0186ff-dc22-4278-8479-6638e1cb44f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75db961e-c7e1-4ca0-b1a9-2f7d36f6b36f (dataset): DatasetConfig { id: 75db961e-c7e1-4ca0-b1a9-2f7d36f6b36f (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 797e95ae-a5d8-4190-93ea-3a7876b3d2f0 (dataset): DatasetConfig { id: 797e95ae-a5d8-4190-93ea-3a7876b3d2f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a447fe3-4701-4d25-b1bd-f292867a57f8 (dataset): DatasetConfig { id: 7a447fe3-4701-4d25-b1bd-f292867a57f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8049255d-b801-42e2-b4da-7fd1e3eedc13 (dataset): DatasetConfig { id: 8049255d-b801-42e2-b4da-7fd1e3eedc13 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83ff934a-222a-4997-a027-24d8c2a547cf (dataset): DatasetConfig { id: 83ff934a-222a-4997-a027-24d8c2a547cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ba16254-8462-40e1-a8bd-e3c903241d56 (dataset): DatasetConfig { id: 8ba16254-8462-40e1-a8bd-e3c903241d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ea84284-65b8-4be9-b254-8cb008601f4e (dataset): DatasetConfig { id: 8ea84284-65b8-4be9-b254-8cb008601f4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8eeb87f5-a12e-437a-8ab0-832881d6366f (dataset): DatasetConfig { id: 8eeb87f5-a12e-437a-8ab0-832881d6366f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9459d716-9000-4650-ad75-0fc321fd9270 (dataset): DatasetConfig { id: 9459d716-9000-4650-ad75-0fc321fd9270 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96b96883-4ff1-4e9d-88d7-a5627b9f6057 (dataset): DatasetConfig { id: 96b96883-4ff1-4e9d-88d7-a5627b9f6057 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99cfe21f-4503-4e26-a3d5-86514183f83b (dataset): DatasetConfig { id: 99cfe21f-4503-4e26-a3d5-86514183f83b (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9f2fccbd-409c-40e4-8180-df286712eb03 (dataset): DatasetConfig { id: 9f2fccbd-409c-40e4-8180-df286712eb03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a213544a-5d95-46b0-ac92-fa0c65e73844 (dataset): DatasetConfig { id: a213544a-5d95-46b0-ac92-fa0c65e73844 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3d64a30-e3e2-499a-8bf1-b5464055a878 (dataset): DatasetConfig { id: a3d64a30-e3e2-499a-8bf1-b5464055a878 (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5b791cd-94cd-45be-a895-4cdf9e597aec (dataset): DatasetConfig { id: a5b791cd-94cd-45be-a895-4cdf9e597aec (dataset), name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab1b99a9-bc12-4758-86d9-db693e846d3a (dataset): DatasetConfig { id: ab1b99a9-bc12-4758-86d9-db693e846d3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b59aa2d9-8862-4bc8-ba5b-4bb3d7099a7e (dataset): DatasetConfig { id: b59aa2d9-8862-4bc8-ba5b-4bb3d7099a7e (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b96c8f3f-ed4b-4802-a9e1-63babdc9f78f (dataset): DatasetConfig { id: b96c8f3f-ed4b-4802-a9e1-63babdc9f78f (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baaacf76-cd9b-4c28-94b3-6da016d08b25 (dataset): DatasetConfig { id: baaacf76-cd9b-4c28-94b3-6da016d08b25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, badbbba3-6b9b-41dc-b002-d42902151d16 (dataset): DatasetConfig { id: badbbba3-6b9b-41dc-b002-d42902151d16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd3664c5-bf4a-472c-b689-0c537d3b88b7 (dataset): DatasetConfig { id: bd3664c5-bf4a-472c-b689-0c537d3b88b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c198195c-f0b8-4e97-b6d4-a630c016eb55 (dataset): DatasetConfig { id: c198195c-f0b8-4e97-b6d4-a630c016eb55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cafed41d-6ec2-40e5-beb8-3825acd5fb79 (dataset): DatasetConfig { id: cafed41d-6ec2-40e5-beb8-3825acd5fb79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf83ca22-0705-4636-956b-ac6ee87fa1fe (dataset): DatasetConfig { id: cf83ca22-0705-4636-956b-ac6ee87fa1fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0418297-eb6e-4d2b-be3c-7c478a23bc85 (dataset): DatasetConfig { id: d0418297-eb6e-4d2b-be3c-7c478a23bc85 (dataset), name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0696982-4014-4c62-963d-3222f01f20b2 (dataset): DatasetConfig { id: d0696982-4014-4c62-963d-3222f01f20b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dd34bfde-2fbe-452e-ab64-88a76dc41fc7 (dataset): DatasetConfig { id: dd34bfde-2fbe-452e-ab64-88a76dc41fc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de68b11e-b342-49c4-b018-253284c11192 (dataset): DatasetConfig { id: de68b11e-b342-49c4-b018-253284c11192 (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ea9422fd-1230-47f0-a97e-9b865f949d5b (dataset): DatasetConfig { id: ea9422fd-1230-47f0-a97e-9b865f949d5b (dataset), name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efc468d0-d520-4268-b8b4-d2afd4bc079f (dataset): DatasetConfig { id: efc468d0-d520-4268-b8b4-d2afd4bc079f (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f62d202b-af47-46dc-a75a-3545c42a0cd3 (dataset): DatasetConfig { id: f62d202b-af47-46dc-a75a-3545c42a0cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f6d6a144-5951-4a16-85a6-3412d0d7a83e (dataset): DatasetConfig { id: f6d6a144-5951-4a16-85a6-3412d0d7a83e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f81499a9-b9a9-49ee-9ddb-de3aae3a272b (dataset): DatasetConfig { id: f81499a9-b9a9-49ee-9ddb-de3aae3a272b (dataset), name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fc4be75a-28d6-48d2-9e15-5e14f89d54cc (dataset): DatasetConfig { id: fc4be75a-28d6-48d2-9e15-5e14f89d54cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4612024-11-28T04:50:04.457ZINFOSledAgent (StorageManager): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-11-28T04:50:04.457ZINFOSledAgent (StorageManager): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4632024-11-28T04:50:04.457ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4642024-11-28T04:50:04.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-11-28T04:50:04.457ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone/oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), full_name: "oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone/oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd" } file = sled-storage/src/manager.rs:1331
4662024-11-28T04:50:04.511ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4672024-11-28T04:50:04.554ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-11-28T04:50:04.554ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4692024-11-28T04:50:04.644ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-11-28T04:50:04.644ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/zone"), full_name: "oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/zone" } file = sled-storage/src/manager.rs:1331
4712024-11-28T04:50:04.711ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-11-28T04:50:04.711ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_33949fdd-4265-4f10-ab58-a876a4529485/crucible" } file = sled-storage/src/manager.rs:1331
4732024-11-28T04:50:04.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-11-28T04:50:04.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf/crucible" } file = sled-storage/src/manager.rs:1331
4752024-11-28T04:50:04.883ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-11-28T04:50:04.883ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/33949fdd-4265-4f10-ab58-a876a4529485/crypt/debug"), full_name: "oxp_33949fdd-4265-4f10-ab58-a876a4529485/crypt/debug" } file = sled-storage/src/manager.rs:1331
4772024-11-28T04:50:04.949ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-28T04:50:04.949ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crucible" } file = sled-storage/src/manager.rs:1331
4792024-11-28T04:50:05.037ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-28T04:50:05.037ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55" } file = sled-storage/src/manager.rs:1331
4812024-11-28T04:50:05.136ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-28T04:50:05.136ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36" } file = sled-storage/src/manager.rs:1331
4832024-11-28T04:50:05.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-11-28T04:50:05.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3abe6613-feef-46d1-ade9-21289cb9be78/crypt/debug"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/debug" } file = sled-storage/src/manager.rs:1331
4852024-11-28T04:50:05.302ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-11-28T04:50:05.302ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306" } file = sled-storage/src/manager.rs:1331
4872024-11-28T04:50:05.403ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-28T04:50:05.403ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46c9f34c-d4c5-49e7-81c2-324226caf2cc/crypt/zone/oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13"), full_name: "oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc/crypt/zone/oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13" } file = sled-storage/src/manager.rs:1331
4892024-11-28T04:50:05.501ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-11-28T04:50:05.501ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b/crucible" } file = sled-storage/src/manager.rs:1331
4912024-11-28T04:50:05.512ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
4922024-11-28T04:50:05.587ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-28T04:50:05.587ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/zone"), full_name: "oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/zone" } file = sled-storage/src/manager.rs:1331
4942024-11-28T04:50:05.652ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-28T04:50:05.652ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc/crucible" } file = sled-storage/src/manager.rs:1331
4962024-11-28T04:50:05.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-11-28T04:50:05.739ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
4982024-11-28T04:50:05.828ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-28T04:50:05.828ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0" } file = sled-storage/src/manager.rs:1331
5002024-11-28T04:50:05.925ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-11-28T04:50:05.925ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/debug"), full_name: "oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/debug" } file = sled-storage/src/manager.rs:1331
5022024-11-28T04:50:05.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-28T04:50:05.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5042024-11-28T04:50:06.081ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-28T04:50:06.081ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5062024-11-28T04:50:06.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-28T04:50:06.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone/oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone/oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2" } file = sled-storage/src/manager.rs:1331
5082024-11-28T04:50:06.272ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-28T04:50:06.272ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/33949fdd-4265-4f10-ab58-a876a4529485/crypt/zone"), full_name: "oxp_33949fdd-4265-4f10-ab58-a876a4529485/crypt/zone" } file = sled-storage/src/manager.rs:1331
5102024-11-28T04:50:06.342ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-28T04:50:06.342ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crucible" } file = sled-storage/src/manager.rs:1331
5122024-11-28T04:50:06.430ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-11-28T04:50:06.430ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/debug"), full_name: "oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/debug" } file = sled-storage/src/manager.rs:1331
5142024-11-28T04:50:06.497ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-11-28T04:50:06.497ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone"), full_name: "oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone" } file = sled-storage/src/manager.rs:1331
5162024-11-28T04:50:06.514ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
5172024-11-28T04:50:06.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-28T04:50:06.563ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/zone/oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c"), full_name: "oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/zone/oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c" } file = sled-storage/src/manager.rs:1331
5192024-11-28T04:50:06.660ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-28T04:50:06.661ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9" } file = sled-storage/src/manager.rs:1331
5212024-11-28T04:50:06.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-28T04:50:06.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone/oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone/oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da" } file = sled-storage/src/manager.rs:1331
5232024-11-28T04:50:06.856ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-28T04:50:06.856ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/zone/oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246"), full_name: "oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/zone/oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246" } file = sled-storage/src/manager.rs:1331
5252024-11-28T04:50:06.953ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-28T04:50:06.953ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798" } file = sled-storage/src/manager.rs:1331
5272024-11-28T04:50:07.052ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-28T04:50:07.053ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crucible" } file = sled-storage/src/manager.rs:1331
5292024-11-28T04:50:07.139ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-11-28T04:50:07.139ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad" } file = sled-storage/src/manager.rs:1331
5312024-11-28T04:50:07.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-11-28T04:50:07.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crucible" } file = sled-storage/src/manager.rs:1331
5332024-11-28T04:50:07.326ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-11-28T04:50:07.326ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5352024-11-28T04:50:07.414ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-11-28T04:50:07.414ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/zone/oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f"), full_name: "oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/zone/oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f" } file = sled-storage/src/manager.rs:1331
5372024-11-28T04:50:07.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-11-28T04:50:07.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone" } file = sled-storage/src/manager.rs:1331
5392024-11-28T04:50:07.517ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
5402024-11-28T04:50:07.583ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-28T04:50:07.583ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46c9f34c-d4c5-49e7-81c2-324226caf2cc/crypt/zone"), full_name: "oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc/crypt/zone" } file = sled-storage/src/manager.rs:1331
5422024-11-28T04:50:07.649ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-28T04:50:07.649ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5442024-11-28T04:50:07.735ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-28T04:50:07.735ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/33949fdd-4265-4f10-ab58-a876a4529485/crypt/zone/oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8"), full_name: "oxp_33949fdd-4265-4f10-ab58-a876a4529485/crypt/zone/oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8" } file = sled-storage/src/manager.rs:1331
5462024-11-28T04:50:07.831ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-11-28T04:50:07.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5482024-11-28T04:50:07.914ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-11-28T04:50:07.914ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/zone/oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a"), full_name: "oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/zone/oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a" } file = sled-storage/src/manager.rs:1331
5502024-11-28T04:50:08.006ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-11-28T04:50:08.006ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone/oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone/oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33" } file = sled-storage/src/manager.rs:1331
5522024-11-28T04:50:08.102ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-11-28T04:50:08.102ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/debug"), full_name: "oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/debug" } file = sled-storage/src/manager.rs:1331
5542024-11-28T04:50:08.164ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-11-28T04:50:08.164ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone" } file = sled-storage/src/manager.rs:1331
5562024-11-28T04:50:08.228ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-11-28T04:50:08.228ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e" } file = sled-storage/src/manager.rs:1331
5582024-11-28T04:50:08.326ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-11-28T04:50:08.326ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/zone/oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d"), full_name: "oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/zone/oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d" } file = sled-storage/src/manager.rs:1331
5602024-11-28T04:50:08.420ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-11-28T04:50:08.420ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5622024-11-28T04:50:08.508ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632024-11-28T04:50:08.508ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa" } file = sled-storage/src/manager.rs:1331
5642024-11-28T04:50:08.519ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
5652024-11-28T04:50:08.599ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-28T04:50:08.599ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5672024-11-28T04:50:08.686ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-28T04:50:08.686ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone/oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3"), full_name: "oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone/oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3" } file = sled-storage/src/manager.rs:1331
5692024-11-28T04:50:08.787ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-11-28T04:50:08.787ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/debug"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/debug" } file = sled-storage/src/manager.rs:1331
5712024-11-28T04:50:08.860ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-11-28T04:50:08.860ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crucible" } file = sled-storage/src/manager.rs:1331
5732024-11-28T04:50:08.946ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-11-28T04:50:08.946ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone/oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4"), full_name: "oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone/oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4" } file = sled-storage/src/manager.rs:1331
5752024-11-28T04:50:09.050ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-11-28T04:50:09.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5772024-11-28T04:50:09.142ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-11-28T04:50:09.142ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f" } file = sled-storage/src/manager.rs:1331
5792024-11-28T04:50:09.240ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-11-28T04:50:09.240ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone/oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f" } file = sled-storage/src/manager.rs:1331
5812024-11-28T04:50:09.338ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-11-28T04:50:09.338ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone/oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23"), full_name: "oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/zone/oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23" } file = sled-storage/src/manager.rs:1331
5832024-11-28T04:50:09.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-11-28T04:50:09.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5852024-11-28T04:50:09.521ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
5862024-11-28T04:50:09.528ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-11-28T04:50:09.528ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/zone"), full_name: "oxp_4f498487-c0df-4538-adab-e17b7773b517/crypt/zone" } file = sled-storage/src/manager.rs:1331
5882024-11-28T04:50:09.597ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-11-28T04:50:09.597ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/debug"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/debug" } file = sled-storage/src/manager.rs:1331
5902024-11-28T04:50:09.674ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5912024-11-28T04:50:09.674ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f"), full_name: "oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/zone/oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f" } file = sled-storage/src/manager.rs:1331
5922024-11-28T04:50:09.776ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5932024-11-28T04:50:09.776ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/zone"), full_name: "oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/zone" } file = sled-storage/src/manager.rs:1331
5942024-11-28T04:50:09.845ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5952024-11-28T04:50:09.845ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/debug"), full_name: "oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/debug" } file = sled-storage/src/manager.rs:1331
5962024-11-28T04:50:09.915ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5972024-11-28T04:50:09.915ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone/oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), full_name: "oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crypt/zone/oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f" } file = sled-storage/src/manager.rs:1331
5982024-11-28T04:50:10.015ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5992024-11-28T04:50:10.015ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46c9f34c-d4c5-49e7-81c2-324226caf2cc/crypt/debug"), full_name: "oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc/crypt/debug" } file = sled-storage/src/manager.rs:1331
6002024-11-28T04:50:10.078ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
6012024-11-28T04:50:10.078ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
6022024-11-28T04:50:10.085ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6032024-11-28T04:50:10.085ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6042024-11-28T04:50:10.088ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6052024-11-28T04:50:10.088ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/zone/oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61"), full_name: "oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/zone/oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61" } file = sled-storage/src/manager.rs:1331
6062024-11-28T04:50:10.206ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6072024-11-28T04:50:10.206ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6082024-11-28T04:50:10.206ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6092024-11-28T04:50:10.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5751979 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49606 req_id = f07d70a0-f596-48d0-8cca-bcf6f68e6a92 response_code = 200 uri = /datasets
6102024-11-28T04:50:10.239ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6112024-11-28T04:50:10.239ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6122024-11-28T04:50:10.256ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 270afd5f-6723-45d0-939c-e46aa54e6cd0 (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2 (service), filesystem_pool: Some(ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
6132024-11-28T04:50:10.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38524
6142024-11-28T04:50:10.257ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 270afd5f-6723-45d0-939c-e46aa54e6cd0, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6152024-11-28T04:50:10.257ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 270afd5f-6723-45d0-939c-e46aa54e6cd0, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6162024-11-28T04:50:10.282ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6172024-11-28T04:50:10.282ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6182024-11-28T04:50:10.291ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6192024-11-28T04:50:10.291ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6202024-11-28T04:50:10.329ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6212024-11-28T04:50:10.329ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6222024-11-28T04:50:10.337ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6232024-11-28T04:50:10.337ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6242024-11-28T04:50:10.362ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6252024-11-28T04:50:10.362ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6262024-11-28T04:50:10.365ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6272024-11-28T04:50:10.365ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:188
6282024-11-28T04:50:10.365ZINFOSledAgent (ServiceManager): No ledger in /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:188
6292024-11-28T04:50:10.365ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6302024-11-28T04:50:10.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6312024-11-28T04:50:10.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6322024-11-28T04:50:10.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6332024-11-28T04:50:10.440ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6342024-11-28T04:50:10.441ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6352024-11-28T04:50:10.471ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8565308842901641735 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6362024-11-28T04:50:10.471ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6575147495899642766 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6372024-11-28T04:50:10.480ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0 file = illumos-utils/src/zone.rs:325
6382024-11-28T04:50:10.484ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f file = illumos-utils/src/zone.rs:325
6392024-11-28T04:50:10.490ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2 file = illumos-utils/src/zone.rs:325
6402024-11-28T04:50:10.501ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0 file = illumos-utils/src/zone.rs:363
6412024-11-28T04:50:10.505ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f file = illumos-utils/src/zone.rs:363
6422024-11-28T04:50:10.512ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2 file = illumos-utils/src/zone.rs:363
6432024-11-28T04:50:10.525ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6442024-11-28T04:50:10.542ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6452024-11-28T04:50:10.542ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6462024-11-28T04:50:10.576ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6472024-11-28T04:50:10.576ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/nexus.rs:527 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6482024-11-28T04:50:10.624ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6492024-11-28T04:50:10.624ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6502024-11-28T04:50:10.625ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6512024-11-28T04:50:10.625ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6522024-11-28T04:50:10.671ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6532024-11-28T04:50:10.696ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 20.596528601s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6542024-11-28T04:50:10.740ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6552024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6562024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6572024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6582024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6592024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6602024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6612024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6622024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6632024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6642024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6652024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6662024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6672024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6682024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6692024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6702024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6712024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6722024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6732024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6742024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6752024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6762024-11-28T04:50:10.740ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6772024-11-28T04:50:11.154ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6782024-11-28T04:50:11.155ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6792024-11-28T04:50:11.527ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
6802024-11-28T04:50:12.126ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-11-28T04:50:12.126ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6822024-11-28T04:50:12.126ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
6832024-11-28T04:50:12.613ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842024-11-28T04:50:13.094ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-11-28T04:50:13.094ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6862024-11-28T04:50:13.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2") failed: Property not found. retry in 47.707041ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
6872024-11-28T04:50:13.102ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6882024-11-28T04:50:13.102ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
6892024-11-28T04:50:13.106ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
6902024-11-28T04:50:13.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2") failed: Property not found. retry in 67.391411ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
6912024-11-28T04:50:13.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 36.436697ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
6922024-11-28T04:50:13.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 41.312267ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
6932024-11-28T04:50:13.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2") failed: Property not found. retry in 197.400963ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
6942024-11-28T04:50:13.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 65.854092ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
6952024-11-28T04:50:13.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 144.85196ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
6962024-11-28T04:50:13.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 279.663931ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
6972024-11-28T04:50:13.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 143.938962ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
6982024-11-28T04:50:13.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2") failed: Property not found. retry in 377.751917ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
6992024-11-28T04:50:13.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 420.92094ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
7002024-11-28T04:50:13.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 364.095097ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
7012024-11-28T04:50:13.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2") failed: Property not found. retry in 1.091516019s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
7022024-11-28T04:50:14.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 444.43414ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
7032024-11-28T04:50:14.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 566.080058ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
7042024-11-28T04:50:14.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 857.870583ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
7052024-11-28T04:50:14.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 1.42627067s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
7062024-11-28T04:50:14.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2") failed: Property not found. retry in 763.735293ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
7072024-11-28T04:50:15.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 1.405630409s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
7082024-11-28T04:50:15.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2") failed: Property not found. retry in 907.090858ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
7092024-11-28T04:50:16.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 539.130225ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
7102024-11-28T04:50:16.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 538.588552ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
7112024-11-28T04:50:16.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2") failed: Property not found. retry in 1.305252397s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
7122024-11-28T04:50:16.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 887.968598ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
7132024-11-28T04:50:17.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0") failed: Property not found. retry in 1.459687716s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
7142024-11-28T04:50:17.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f") failed: Property not found. retry in 1.159624714s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
7152024-11-28T04:50:18.899ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_270afd5f-6723-45d0-939c-e46aa54e6cd0
7162024-11-28T04:50:18.899ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_67da07c9-cebe-4b75-ae7c-47ee15182d8f
7172024-11-28T04:50:18.899ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_397d4fca-48c2-4546-a2f2-1a6b08a3c4e2
7182024-11-28T04:50:18.899ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7192024-11-28T04:50:18.899ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7202024-11-28T04:50:18.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8643179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38524 req_id = 6b830a4b-f26c-468e-b38c-bb4707a498a6 response_code = 204 uri = /omicron-zones
7212024-11-28T04:50:18.902ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7222024-11-28T04:50:19.073ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 123.362808ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:662
7232024-11-28T04:50:19.213ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7242024-11-28T04:50:19.260ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:642
7252024-11-28T04:50:19.303ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:678
7262024-11-28T04:50:19.303ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7272024-11-28T04:50:19.334ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7282024-11-28T04:50:19.335ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7292024-11-28T04:50:19.335ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7302024-11-28T04:50:19.364ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 270afd5f-6723-45d0-939c-e46aa54e6cd0 (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2 (service), filesystem_pool: Some(ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6aeebbbf-d7fb-4df0-8468-d87378c9b306 (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1d5af9d6-ff84-4c5e-9c66-0e0d65161a8e, kind: Service { id: 6aeebbbf-d7fb-4df0-8468-d87378c9b306 }, name: Name("ntp-6aeebbbf-d7fb-4df0-8468-d87378c9b306"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 44])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
7312024-11-28T04:50:19.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35537
7322024-11-28T04:50:19.364ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 270afd5f-6723-45d0-939c-e46aa54e6cd0, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7332024-11-28T04:50:19.364ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 270afd5f-6723-45d0-939c-e46aa54e6cd0, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7342024-11-28T04:50:19.402ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7352024-11-28T04:50:19.402ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7362024-11-28T04:50:19.436ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7372024-11-28T04:50:19.436ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7382024-11-28T04:50:19.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7392024-11-28T04:50:19.468ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
7402024-11-28T04:50:19.468ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
7412024-11-28T04:50:19.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7422024-11-28T04:50:19.479ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7432024-11-28T04:50:19.511ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7442024-11-28T04:50:19.512ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7452024-11-28T04:50:19.512ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7462024-11-28T04:50:19.542ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 197, 44]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7472024-11-28T04:50:19.542ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7482024-11-28T04:50:19.543ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7492024-11-28T04:50:19.543ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7502024-11-28T04:50:19.543ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7512024-11-28T04:50:19.543ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7522024-11-28T04:50:19.567ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306 file = illumos-utils/src/zone.rs:325
7532024-11-28T04:50:19.584ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306 file = illumos-utils/src/zone.rs:363
7542024-11-28T04:50:20.205ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7552024-11-28T04:50:20.205ZINFOSledAgent (ServiceManager): Booting oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7562024-11-28T04:50:20.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306") failed: Property not found. retry in 67.954668ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7572024-11-28T04:50:20.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306") failed: Property not found. retry in 145.343147ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7582024-11-28T04:50:20.474ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8565308842901641735 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7592024-11-28T04:50:20.474ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6575147495899642766 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7602024-11-28T04:50:20.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306") failed: Property not found. retry in 158.332133ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7612024-11-28T04:50:20.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306") failed: Property not found. retry in 467.196491ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7622024-11-28T04:50:21.157ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7632024-11-28T04:50:21.157ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7642024-11-28T04:50:21.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306") failed: Property not found. retry in 1.147478365s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7652024-11-28T04:50:22.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306") failed: Property not found. retry in 1.426456626s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7662024-11-28T04:50:23.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306") failed: Property not found. retry in 1.284502186s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7672024-11-28T04:50:25.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306
7682024-11-28T04:50:25.137ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692024-11-28T04:50:25.138ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702024-11-28T04:50:25.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5773785 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35537 req_id = 92cfbb35-4fe0-4111-9f09-a72ea84a18b6 response_code = 204 uri = /omicron-zones
7712024-11-28T04:50:25.140ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:719
7722024-11-28T04:50:25.171ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7732024-11-28T04:50:25.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51617
7742024-11-28T04:50:25.182ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7752024-11-28T04:50:25.182ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10794 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51617 req_id = ba624ab5-e24b-47d7-ae39-4cab139d9637 response_code = 500 uri = /timesync
7762024-11-28T04:50:25.184ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7772024-11-28T04:50:25.320ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7782024-11-28T04:50:25.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64737
7792024-11-28T04:50:28.016ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8811084202232518283 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7802024-11-28T04:50:28.683ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1657593830012784609 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7812024-11-28T04:50:28.902ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15804892690211428822 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7822024-11-28T04:50:29.329ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7832024-11-28T04:50:29.329ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64737 req_id = a070f552-6461-41cb-ba9f-0be47d7638b8 response_code = 500 uri = /timesync
7842024-11-28T04:50:29.331ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7852024-11-28T04:50:29.451ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7862024-11-28T04:50:29.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52914
7872024-11-28T04:50:29.459ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7882024-11-28T04:50:29.459ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8092 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52914 req_id = 60e752c0-2498-4461-9983-1c655539f0f5 response_code = 500 uri = /timesync
7892024-11-28T04:50:29.461ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7902024-11-28T04:50:29.688ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7912024-11-28T04:50:29.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54485
7922024-11-28T04:50:29.696ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6aeebbbf-d7fb-4df0-8468-d87378c9b306': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7932024-11-28T04:50:29.696ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7728 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54485 req_id = 4b8fa7f7-8b36-49c7-926b-cfedc2366f0d response_code = 500 uri = /timesync
7942024-11-28T04:50:29.698ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
7952024-11-28T04:50:29.845ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
7962024-11-28T04:50:29.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49116
7972024-11-28T04:50:30.476ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8565308842901641735 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7982024-11-28T04:50:30.476ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6575147495899642766 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
7992024-11-28T04:50:31.159ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8002024-11-28T04:50:31.159ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8012024-11-28T04:50:31.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007622 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49116 req_id = 0e2862a6-a5d5-4b8a-8792-4bc79aef2506 response_code = 200 uri = /timesync
8022024-11-28T04:50:31.192ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:727
8032024-11-28T04:50:31.192ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8042024-11-28T04:50:32.098ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8052024-11-28T04:50:32.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58112
8062024-11-28T04:50:32.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8851 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58112 req_id = ffc4d81c-a0ac-4879-a732-3dbe205a33be response_code = 200 uri = /timesync
8072024-11-28T04:50:32.108ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:727
8082024-11-28T04:50:32.108ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8092024-11-28T04:50:32.498ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8102024-11-28T04:50:32.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62685
8112024-11-28T04:50:32.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62685 req_id = 815f5f70-df19-4925-b21b-ea7db3acb14b response_code = 200 uri = /timesync
8122024-11-28T04:50:32.508ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:727
8132024-11-28T04:50:32.508ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8142024-11-28T04:50:32.839ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8152024-11-28T04:50:32.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41825
8162024-11-28T04:50:32.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7491 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41825 req_id = 40239bc1-3092-43cd-865a-c225cc369239 response_code = 200 uri = /timesync
8172024-11-28T04:50:32.848ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 265050079, ip_addr: 15.204.87.223, stratum: 3, ref_time: 1732769432.2328756, correction: -0.326356709 } file = sled-agent/src/rack_setup/service.rs:727
8182024-11-28T04:50:32.848ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8192024-11-28T04:50:33.140ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8202024-11-28T04:50:33.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33325
8212024-11-28T04:50:33.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33325 req_id = ff4392a3-72b7-43b7-9a8f-9d05ca0b30b9 response_code = 200 uri = /timesync
8222024-11-28T04:50:33.149ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732769431.4130678, correction: -0.325539231 } file = sled-agent/src/rack_setup/service.rs:727
8232024-11-28T04:50:33.149ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8242024-11-28T04:50:33.557ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8252024-11-28T04:50:33.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65193
8262024-11-28T04:50:33.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7710 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65193 req_id = 17e324eb-5d2b-477f-85d7-321f356eae43 response_code = 200 uri = /timesync
8272024-11-28T04:50:33.567ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732769431.4130678, correction: -0.316710204 } file = sled-agent/src/rack_setup/service.rs:727
8282024-11-28T04:50:33.567ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8292024-11-28T04:50:33.986ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8302024-11-28T04:50:33.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52962
8312024-11-28T04:50:33.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52962 req_id = 7cea550c-4f43-494d-87ec-b06c11ef61cf response_code = 200 uri = /timesync
8322024-11-28T04:50:33.996ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732769431.4130678, correction: -0.315545112 } file = sled-agent/src/rack_setup/service.rs:727
8332024-11-28T04:50:33.996ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8342024-11-28T04:50:34.373ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8352024-11-28T04:50:34.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34539
8362024-11-28T04:50:34.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34539 req_id = 2b81060d-040a-43ee-bd58-8bf0936c26d6 response_code = 200 uri = /timesync
8372024-11-28T04:50:34.383ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732769431.4130678, correction: -0.316878498 } file = sled-agent/src/rack_setup/service.rs:727
8382024-11-28T04:50:34.383ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8392024-11-28T04:50:35.076ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8249950080861268277 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8402024-11-28T04:50:35.076ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12284282245761608909 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8412024-11-28T04:50:35.486ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8422024-11-28T04:50:35.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40432
8432024-11-28T04:50:35.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7923 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40432 req_id = fb5eb94d-4d00-4151-8996-62cd32ef1404 response_code = 200 uri = /timesync
8442024-11-28T04:50:35.496ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769434.3810034, correction: -0.313433647 } file = sled-agent/src/rack_setup/service.rs:727
8452024-11-28T04:50:35.496ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8462024-11-28T04:50:35.974ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8472024-11-28T04:50:35.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45120
8482024-11-28T04:50:35.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45120 req_id = b32d499a-5d90-464e-b0b2-db3a9f5e584b response_code = 200 uri = /timesync
8492024-11-28T04:50:35.985ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769434.3810034, correction: -0.312105536 } file = sled-agent/src/rack_setup/service.rs:727
8502024-11-28T04:50:35.985ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8512024-11-28T04:50:36.851ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8522024-11-28T04:50:36.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65150
8532024-11-28T04:50:36.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7700 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65150 req_id = 929091cb-45dc-49d7-832c-f4e75bdb440b response_code = 200 uri = /timesync
8542024-11-28T04:50:36.861ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769435.5407572, correction: -0.310007125 } file = sled-agent/src/rack_setup/service.rs:727
8552024-11-28T04:50:36.861ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8562024-11-28T04:50:37.945ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8811084202232518283 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8572024-11-28T04:50:38.582ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8582024-11-28T04:50:38.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62145
8592024-11-28T04:50:38.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8542 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62145 req_id = 827ca0f8-d3cb-4647-8daa-e00c93703e94 response_code = 200 uri = /timesync
8602024-11-28T04:50:38.594ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769437.9866064, correction: -0.304646641 } file = sled-agent/src/rack_setup/service.rs:727
8612024-11-28T04:50:38.594ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8622024-11-28T04:50:38.611ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1657593830012784609 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8632024-11-28T04:50:38.829ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15804892690211428822 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8642024-11-28T04:50:40.176ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8652024-11-28T04:50:40.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52782
8662024-11-28T04:50:40.182ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46345
8672024-11-28T04:50:40.182ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46345 req_id = b4ce2611-2dd6-471c-a85e-0a1bdb097836 response_code = 200 uri = /baseboard
8682024-11-28T04:50:40.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8809 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52782 req_id = 01f0a313-717d-42cb-b334-b4ec702a399f response_code = 200 uri = /timesync
8692024-11-28T04:50:40.187ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769438.7881837, correction: -0.300182045 } file = sled-agent/src/rack_setup/service.rs:727
8702024-11-28T04:50:40.187ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8712024-11-28T04:50:40.399ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8565308842901641735 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8722024-11-28T04:50:40.399ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6575147495899642766 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8732024-11-28T04:50:41.079ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8742024-11-28T04:50:41.079ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8752024-11-28T04:50:42.956ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8762024-11-28T04:50:42.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51529
8772024-11-28T04:50:42.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8731 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51529 req_id = d9681238-19b8-4b61-ae6f-2f185912e6ed response_code = 200 uri = /timesync
8782024-11-28T04:50:42.967ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769440.9560175, correction: -0.292494535 } file = sled-agent/src/rack_setup/service.rs:727
8792024-11-28T04:50:42.967ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8802024-11-28T04:50:45.051ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8249950080861268277 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8812024-11-28T04:50:45.051ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12284282245761608909 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8822024-11-28T04:50:46.058ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8832024-11-28T04:50:46.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64830
8842024-11-28T04:50:46.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8846 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64830 req_id = cb9eda29-838f-4bd1-a2c5-d60a1a95f2af response_code = 200 uri = /timesync
8852024-11-28T04:50:46.069ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769444.1956313, correction: -0.284269869 } file = sled-agent/src/rack_setup/service.rs:727
8862024-11-28T04:50:46.069ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8872024-11-28T04:50:46.236ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 225.838513ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8882024-11-28T04:50:47.920ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8811084202232518283 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8892024-11-28T04:50:48.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1657593830012784609 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8902024-11-28T04:50:48.804ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15804892690211428822 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8912024-11-28T04:50:49.834ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
8922024-11-28T04:50:49.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52076
8932024-11-28T04:50:49.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8729 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52076 req_id = 13285ed1-fd11-4759-89c0-f43c32e77c25 response_code = 200 uri = /timesync
8942024-11-28T04:50:49.846ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769448.4640107, correction: -0.273990065 } file = sled-agent/src/rack_setup/service.rs:727
8952024-11-28T04:50:49.846ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
8962024-11-28T04:50:50.375ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8565308842901641735 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8972024-11-28T04:50:50.375ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6575147495899642766 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8982024-11-28T04:50:51.054ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
8992024-11-28T04:50:51.054ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9002024-11-28T04:50:52.428ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9012024-11-28T04:50:52.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43799
9022024-11-28T04:50:52.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8604 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43799 req_id = da3ada15-b50d-4929-813e-a45f9c29d7b0 response_code = 200 uri = /timesync
9032024-11-28T04:50:52.439ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769451.0842495, correction: -0.267013133 } file = sled-agent/src/rack_setup/service.rs:727
9042024-11-28T04:50:52.439ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9052024-11-28T04:50:55.026ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8249950080861268277 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9062024-11-28T04:50:55.026ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12284282245761608909 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9072024-11-28T04:50:57.246ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9082024-11-28T04:50:57.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56859
9092024-11-28T04:50:57.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8792 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56859 req_id = 857d52b6-d7b0-4acf-8b0b-2eb024016b72 response_code = 200 uri = /timesync
9102024-11-28T04:50:57.258ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769455.4118578, correction: -0.253943086 } file = sled-agent/src/rack_setup/service.rs:727
9112024-11-28T04:50:57.258ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9122024-11-28T04:50:57.895ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8811084202232518283 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9132024-11-28T04:50:58.559ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1657593830012784609 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9142024-11-28T04:50:58.779ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15804892690211428822 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9152024-11-28T04:50:59.770ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9162024-11-28T04:50:59.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41895
9172024-11-28T04:50:59.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41895 req_id = d0ab4230-26e0-4364-ad83-79b08006f335 response_code = 200 uri = /timesync
9182024-11-28T04:50:59.781ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769459.1931312, correction: -0.246983469 } file = sled-agent/src/rack_setup/service.rs:727
9192024-11-28T04:50:59.781ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9202024-11-28T04:51:00.349ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8565308842901641735 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9212024-11-28T04:51:00.350ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6575147495899642766 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9222024-11-28T04:51:01.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9232024-11-28T04:51:01.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9242024-11-28T04:51:01.454ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 651.669421ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9252024-11-28T04:51:04.672ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9262024-11-28T04:51:04.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42314
9272024-11-28T04:51:04.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8450 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42314 req_id = b6f58aca-4206-4b91-a950-2441107a5d46 response_code = 200 uri = /timesync
9282024-11-28T04:51:04.684ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769462.6622772, correction: -0.233568385 } file = sled-agent/src/rack_setup/service.rs:727
9292024-11-28T04:51:04.684ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9302024-11-28T04:51:05.000ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8249950080861268277 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9312024-11-28T04:51:05.001ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12284282245761608909 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9322024-11-28T04:51:07.869ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8811084202232518283 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9332024-11-28T04:51:08.534ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1657593830012784609 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9342024-11-28T04:51:08.754ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15804892690211428822 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9352024-11-28T04:51:10.134ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49877
9362024-11-28T04:51:10.134ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49877 req_id = c684811b-cfb7-45be-a428-7c319e31a7a5 response_code = 200 uri = /baseboard
9372024-11-28T04:51:10.324ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8565308842901641735 reason = Duration(60s) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9382024-11-28T04:51:10.324ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6575147495899642766 reason = Duration(60s) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9392024-11-28T04:51:10.552ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9402024-11-28T04:51:10.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39184
9412024-11-28T04:51:10.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8797 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39184 req_id = 8d57089a-c3bb-4014-ba20-bc6bae7853bc response_code = 200 uri = /timesync
9422024-11-28T04:51:10.563ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769469.7427456, correction: -0.217880547 } file = sled-agent/src/rack_setup/service.rs:727
9432024-11-28T04:51:10.563ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9442024-11-28T04:51:11.003ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9452024-11-28T04:51:11.003ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9462024-11-28T04:51:14.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8249950080861268277 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9472024-11-28T04:51:14.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12284282245761608909 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9482024-11-28T04:51:15.190ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9492024-11-28T04:51:15.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35720
9502024-11-28T04:51:15.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8839 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35720 req_id = b399da77-925b-4292-a5fe-36b77022db88 response_code = 200 uri = /timesync
9512024-11-28T04:51:15.201ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769473.702572, correction: -0.205273733 } file = sled-agent/src/rack_setup/service.rs:727
9522024-11-28T04:51:15.201ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9532024-11-28T04:51:17.098ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 572.965303ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9542024-11-28T04:51:17.844ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8811084202232518283 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9552024-11-28T04:51:18.508ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1657593830012784609 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9562024-11-28T04:51:18.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15804892690211428822 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9572024-11-28T04:51:20.978ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9582024-11-28T04:51:20.978ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9592024-11-28T04:51:24.950ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8249950080861268277 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9602024-11-28T04:51:24.950ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12284282245761608909 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9612024-11-28T04:51:26.783ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9622024-11-28T04:51:26.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39643
9632024-11-28T04:51:26.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9542 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39643 req_id = e356e029-edf3-4c11-80f2-9c45bce01df4 response_code = 200 uri = /timesync
9642024-11-28T04:51:26.795ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769484.337638, correction: -0.173866034 } file = sled-agent/src/rack_setup/service.rs:727
9652024-11-28T04:51:26.795ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9662024-11-28T04:51:27.820ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8811084202232518283 reason = Duration(60s) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9672024-11-28T04:51:28.482ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1657593830012784609 reason = Duration(60s) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9682024-11-28T04:51:28.704ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15804892690211428822 reason = Duration(60s) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9692024-11-28T04:51:30.952ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9702024-11-28T04:51:30.952ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9712024-11-28T04:51:32.664ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.586437133s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9722024-11-28T04:51:34.395ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9732024-11-28T04:51:34.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46096
9742024-11-28T04:51:34.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8794 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46096 req_id = b35c2f94-fe95-4019-a9fd-847a7c3b7bdf response_code = 200 uri = /timesync
9752024-11-28T04:51:34.407ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769492.032406, correction: -0.153130695 } file = sled-agent/src/rack_setup/service.rs:727
9762024-11-28T04:51:34.407ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9772024-11-28T04:51:34.925ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8249950080861268277 reason = Duration(60s) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9782024-11-28T04:51:34.925ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12284282245761608909 reason = Duration(60s) sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9792024-11-28T04:51:40.084ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33636
9802024-11-28T04:51:40.084ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33636 req_id = a98455b2-a0dc-4998-93c9-7d16dba3e79a response_code = 200 uri = /baseboard
9812024-11-28T04:51:40.927ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9822024-11-28T04:51:40.928ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9832024-11-28T04:51:45.077ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9842024-11-28T04:51:45.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46810
9852024-11-28T04:51:45.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46810 req_id = 557baa2e-a742-40a3-abd9-598f56b4557b response_code = 200 uri = /timesync
9862024-11-28T04:51:45.089ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769504.2778258, correction: -0.123985849 } file = sled-agent/src/rack_setup/service.rs:727
9872024-11-28T04:51:45.089ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9882024-11-28T04:51:49.239ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.786881049s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9892024-11-28T04:51:50.903ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9902024-11-28T04:51:50.903ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9912024-11-28T04:52:00.877ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9922024-11-28T04:52:00.877ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9932024-11-28T04:52:04.590ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
9942024-11-28T04:52:04.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39407
9952024-11-28T04:52:04.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9028 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39407 req_id = 83ad9eb8-500c-4c1f-a255-ba59e914454d response_code = 200 uri = /timesync
9962024-11-28T04:52:04.602ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769520.9565644, correction: -0.070966795 } file = sled-agent/src/rack_setup/service.rs:727
9972024-11-28T04:52:04.602ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:749
9982024-11-28T04:52:09.007ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.133837222s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
9992024-11-28T04:52:10.034ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44178
10002024-11-28T04:52:10.034ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44178 req_id = c3232c54-297a-456b-8ad2-bd85e3a4913e response_code = 200 uri = /baseboard
10012024-11-28T04:52:10.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17318729954148179303 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10022024-11-28T04:52:10.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8174336303114232911 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10032024-11-28T04:52:19.045ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:699
10042024-11-28T04:52:19.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46157
10052024-11-28T04:52:19.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22588 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46157 req_id = c8c104aa-398f-439d-87f9-8c3e363d1f1d response_code = 200 uri = /timesync
10062024-11-28T04:52:19.070ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-28T04:51:28.482290310Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1657593830012784609 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10072024-11-28T04:52:19.070ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-28T04:51:28.704828581Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15804892690211428822 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10082024-11-28T04:52:19.070ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-28T04:51:34.925446459Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8249950080861268277 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10092024-11-28T04:52:19.070ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-28T04:51:34.925867798Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12284282245761608909 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10102024-11-28T04:52:19.070ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-28T04:51:27.820441276Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8811084202232518283 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10112024-11-28T04:52:19.070ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-28T04:51:10.324908249Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6575147495899642766 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10122024-11-28T04:52:19.071ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-28T04:51:10.324367047Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8565308842901641735 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
10132024-11-28T04:52:19.072ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3629264261, ip_addr: 216.82.45.133, stratum: 2, ref_time: 1732769536.6443086, correction: -0.031670514 } file = sled-agent/src/rack_setup/service.rs:727
10142024-11-28T04:52:19.072ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1412
10152024-11-28T04:52:19.103ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 270afd5f-6723-45d0-939c-e46aa54e6cd0 (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2 (service), filesystem_pool: Some(ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6aeebbbf-d7fb-4df0-8468-d87378c9b306 (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1d5af9d6-ff84-4c5e-9c66-0e0d65161a8e, kind: Service { id: 6aeebbbf-d7fb-4df0-8468-d87378c9b306 }, name: Name("ntp-6aeebbbf-d7fb-4df0-8468-d87378c9b306"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 44])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: c0065690-4f77-48ae-8bca-b24f525a36ad (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } } } }, OmicronZoneConfig { id: ff691ffa-ed55-4af6-a133-e38607d5ea33 (service), filesystem_pool: Some(ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3286dc7d-bcfc-40aa-b6a5-187747e3429e (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External } } } }, OmicronZoneConfig { id: fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246 (service), filesystem_pool: Some(ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External } } } }, OmicronZoneConfig { id: cc77849b-ad20-4482-9b25-55ec332c16e4 (service), filesystem_pool: Some(ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
10162024-11-28T04:52:19.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58263
10172024-11-28T04:52:19.103ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 270afd5f-6723-45d0-939c-e46aa54e6cd0, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10182024-11-28T04:52:19.103ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 270afd5f-6723-45d0-939c-e46aa54e6cd0, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10192024-11-28T04:52:19.138ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10202024-11-28T04:52:19.138ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10212024-11-28T04:52:19.169ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10222024-11-28T04:52:19.169ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10232024-11-28T04:52:19.203ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c0065690-4f77-48ae-8bca-b24f525a36ad, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10242024-11-28T04:52:19.203ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c0065690-4f77-48ae-8bca-b24f525a36ad, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10252024-11-28T04:52:19.234ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff691ffa-ed55-4af6-a133-e38607d5ea33, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10262024-11-28T04:52:19.234ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff691ffa-ed55-4af6-a133-e38607d5ea33, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10272024-11-28T04:52:19.265ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3286dc7d-bcfc-40aa-b6a5-187747e3429e, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10282024-11-28T04:52:19.265ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3286dc7d-bcfc-40aa-b6a5-187747e3429e, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10292024-11-28T04:52:19.296ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246, dataset_name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10302024-11-28T04:52:19.296ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246, dataset_name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Cockroach }, responder: ... }
10312024-11-28T04:52:19.329ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc77849b-ad20-4482-9b25-55ec332c16e4, dataset_name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10322024-11-28T04:52:19.329ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cc77849b-ad20-4482-9b25-55ec332c16e4, dataset_name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10332024-11-28T04:52:19.359ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10342024-11-28T04:52:19.359ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
10352024-11-28T04:52:19.360ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
10362024-11-28T04:52:19.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10372024-11-28T04:52:19.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10382024-11-28T04:52:19.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10392024-11-28T04:52:19.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10402024-11-28T04:52:19.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10412024-11-28T04:52:19.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10422024-11-28T04:52:19.529ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4 file = illumos-utils/src/zone.rs:325
10432024-11-28T04:52:19.533ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33 file = illumos-utils/src/zone.rs:325
10442024-11-28T04:52:19.537ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e file = illumos-utils/src/zone.rs:325
10452024-11-28T04:52:19.542ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad file = illumos-utils/src/zone.rs:325
10462024-11-28T04:52:19.546ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246 file = illumos-utils/src/zone.rs:325
10472024-11-28T04:52:19.551ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4 file = illumos-utils/src/zone.rs:363
10482024-11-28T04:52:19.555ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33 file = illumos-utils/src/zone.rs:363
10492024-11-28T04:52:19.560ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e file = illumos-utils/src/zone.rs:363
10502024-11-28T04:52:19.565ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad file = illumos-utils/src/zone.rs:363
10512024-11-28T04:52:19.569ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246 file = illumos-utils/src/zone.rs:363
10522024-11-28T04:52:22.513ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ff691ffa-ed55-4af6-a133-e38607d5ea33'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10532024-11-28T04:52:22.514ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
10542024-11-28T04:52:22.554ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c0065690-4f77-48ae-8bca-b24f525a36ad'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10552024-11-28T04:52:22.554ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10562024-11-28T04:52:22.578ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3286dc7d-bcfc-40aa-b6a5-187747e3429e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10572024-11-28T04:52:22.578ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
10582024-11-28T04:52:22.584ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10592024-11-28T04:52:22.584ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
10602024-11-28T04:52:22.638ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cc77849b-ad20-4482-9b25-55ec332c16e4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10612024-11-28T04:52:22.639ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10622024-11-28T04:52:22.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 67.779515ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
10632024-11-28T04:52:22.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 53.850838ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10642024-11-28T04:52:22.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 63.38881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
10652024-11-28T04:52:22.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 61.654822ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
10662024-11-28T04:52:22.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 122.189039ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
10672024-11-28T04:52:22.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 133.313331ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10682024-11-28T04:52:23.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 283.963163ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
10692024-11-28T04:52:23.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 134.758056ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
10702024-11-28T04:52:23.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 57.869427ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
10712024-11-28T04:52:23.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 35.663321ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10722024-11-28T04:52:23.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 142.235511ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10732024-11-28T04:52:24.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 104.290206ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10742024-11-28T04:52:24.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 406.07414ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
10752024-11-28T04:52:24.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 272.789497ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
10762024-11-28T04:52:24.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 527.859115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10772024-11-28T04:52:24.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 153.73879ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
10782024-11-28T04:52:25.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 186.080076ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10792024-11-28T04:52:25.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 711.139613ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
10802024-11-28T04:52:25.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 576.153512ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
10812024-11-28T04:52:25.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 559.305881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
10822024-11-28T04:52:25.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 224.152676ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10832024-11-28T04:52:25.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 408.493393ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10842024-11-28T04:52:25.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 771.697026ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10852024-11-28T04:52:25.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 667.776906ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
10862024-11-28T04:52:25.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 1.093254834s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
10872024-11-28T04:52:25.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 1.361394666s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
10882024-11-28T04:52:25.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 854.556873ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10892024-11-28T04:52:26.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 680.247142ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10902024-11-28T04:52:26.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 627.490128ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
10912024-11-28T04:52:26.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 717.013628ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10922024-11-28T04:52:26.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 825.131943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
10932024-11-28T04:52:26.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 735.746789ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10942024-11-28T04:52:27.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 919.303985ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
10952024-11-28T04:52:27.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 567.397872ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
10962024-11-28T04:52:27.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 1.020493706s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
10972024-11-28T04:52:27.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 1.101194644s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
10982024-11-28T04:52:27.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 579.754014ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
10992024-11-28T04:52:27.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 802.352534ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11002024-11-28T04:52:27.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 631.099651ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11012024-11-28T04:52:28.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 740.560967ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11022024-11-28T04:52:28.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 1.36396647s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
11032024-11-28T04:52:28.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 696.040435ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11042024-11-28T04:52:28.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 896.467172ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11052024-11-28T04:52:28.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 1.262015691s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
11062024-11-28T04:52:29.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 900.458314ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11072024-11-28T04:52:29.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 1.185695831s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11082024-11-28T04:52:29.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 865.146933ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11092024-11-28T04:52:29.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 724.976326ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
11102024-11-28T04:52:29.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 845.140373ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11112024-11-28T04:52:30.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 1.465321923s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
11122024-11-28T04:52:30.119ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.717783539s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
11132024-11-28T04:52:30.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 1.432877711s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11142024-11-28T04:52:30.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 1.29863614s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11152024-11-28T04:52:30.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 1.279772001s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
11162024-11-28T04:52:30.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 976.878756ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11172024-11-28T04:52:31.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 1.444512136s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
11182024-11-28T04:52:31.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 1.454836353s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11192024-11-28T04:52:31.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 1.431524215s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11202024-11-28T04:52:31.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 956.636221ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11212024-11-28T04:52:31.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 542.908972ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
11222024-11-28T04:52:32.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 1.391735633s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
11232024-11-28T04:52:32.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 971.066895ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11242024-11-28T04:52:32.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 512.788794ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
11252024-11-28T04:52:33.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 540.855038ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11262024-11-28T04:52:33.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 1.156587784s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11272024-11-28T04:52:33.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 1.305790465s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
11282024-11-28T04:52:33.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 723.605609ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11292024-11-28T04:52:33.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 1.120686268s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11302024-11-28T04:52:33.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 785.919416ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
11312024-11-28T04:52:34.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 715.6546ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11322024-11-28T04:52:34.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33") failed: Property not found. retry in 1.100886689s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11332024-11-28T04:52:34.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4") failed: Property not found. retry in 1.479269025s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
11342024-11-28T04:52:34.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e") failed: Property not found. retry in 1.440866696s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
11352024-11-28T04:52:34.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246") failed: Property not found. retry in 1.037855423s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11362024-11-28T04:52:35.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad") failed: Property not found. retry in 1.002110142s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11372024-11-28T04:52:36.292ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_cc77849b-ad20-4482-9b25-55ec332c16e4
11382024-11-28T04:52:36.292ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ff691ffa-ed55-4af6-a133-e38607d5ea33
11392024-11-28T04:52:36.292ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e
11402024-11-28T04:52:36.292ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_c0065690-4f77-48ae-8bca-b24f525a36ad
11412024-11-28T04:52:36.292ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246
11422024-11-28T04:52:36.292ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11432024-11-28T04:52:36.293ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11442024-11-28T04:52:36.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17222504 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58263 req_id = 6b14655c-f31b-4cf7-bc47-fc6e0eeb4ec0 response_code = 204 uri = /omicron-zones
11452024-11-28T04:52:36.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39077
11462024-11-28T04:52:36.355ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28758 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 7091fe85-6135-4705-b5f1-7e9f88f625fd response_code = 500 uri = /cockroachdb
11472024-11-28T04:52:36.355ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7091fe85-6135-4705-b5f1-7e9f88f625fd", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7091fe85-6135-4705-b5f1-7e9f88f625fd" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 119.746733ms
11482024-11-28T04:52:36.502ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = eb7aad5d-dbbd-4865-9774-0ff839e0fbc0 response_code = 500 uri = /cockroachdb
11492024-11-28T04:52:36.503ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "eb7aad5d-dbbd-4865-9774-0ff839e0fbc0", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "eb7aad5d-dbbd-4865-9774-0ff839e0fbc0" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 96.23273ms
11502024-11-28T04:52:36.629ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 8972b9ee-f0c1-4206-8660-6e066814676e response_code = 500 uri = /cockroachdb
11512024-11-28T04:52:36.629ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8972b9ee-f0c1-4206-8660-6e066814676e", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8972b9ee-f0c1-4206-8660-6e066814676e" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 171.756649ms
11522024-11-28T04:52:36.829ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = d5fd8eda-75f1-4e66-8e96-4ff33be5e3f9 response_code = 500 uri = /cockroachdb
11532024-11-28T04:52:36.829ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d5fd8eda-75f1-4e66-8e96-4ff33be5e3f9", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d5fd8eda-75f1-4e66-8e96-4ff33be5e3f9" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 236.197682ms
11542024-11-28T04:52:37.094ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 3f70f181-8270-434e-acc4-fb7d8438da8b response_code = 500 uri = /cockroachdb
11552024-11-28T04:52:37.095ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3f70f181-8270-434e-acc4-fb7d8438da8b", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3f70f181-8270-434e-acc4-fb7d8438da8b" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 202.473945ms
11562024-11-28T04:52:37.324ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26496 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 54ef86ef-303a-4314-8b77-32ae1c0913ac response_code = 500 uri = /cockroachdb
11572024-11-28T04:52:37.325ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "54ef86ef-303a-4314-8b77-32ae1c0913ac", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "54ef86ef-303a-4314-8b77-32ae1c0913ac" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 314.383993ms
11582024-11-28T04:52:37.666ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 098d1dbf-d723-4282-a6c7-16222934c8f5 response_code = 500 uri = /cockroachdb
11592024-11-28T04:52:37.667ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "098d1dbf-d723-4282-a6c7-16222934c8f5", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "098d1dbf-d723-4282-a6c7-16222934c8f5" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 321.857777ms
11602024-11-28T04:52:38.015ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 7fda8d5c-4404-4eb5-8780-c3f2a217afeb response_code = 500 uri = /cockroachdb
11612024-11-28T04:52:38.016ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7fda8d5c-4404-4eb5-8780-c3f2a217afeb", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7fda8d5c-4404-4eb5-8780-c3f2a217afeb" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 516.905501ms
11622024-11-28T04:52:38.559ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25999 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 4d1f4208-b837-4fc7-9536-b0b14f2916a8 response_code = 500 uri = /cockroachdb
11632024-11-28T04:52:38.559ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4d1f4208-b837-4fc7-9536-b0b14f2916a8", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4d1f4208-b837-4fc7-9536-b0b14f2916a8" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 222.99473ms
11642024-11-28T04:52:38.810ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26628 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = db4fc7ba-87d8-47d2-93dd-55066b1fa4ff response_code = 500 uri = /cockroachdb
11652024-11-28T04:52:38.810ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "db4fc7ba-87d8-47d2-93dd-55066b1fa4ff", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "db4fc7ba-87d8-47d2-93dd-55066b1fa4ff" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 299.022019ms
11662024-11-28T04:52:39.138ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 68d21e63-c5ea-4332-8a20-eca8e3d3843f response_code = 500 uri = /cockroachdb
11672024-11-28T04:52:39.138ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "68d21e63-c5ea-4332-8a20-eca8e3d3843f", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "68d21e63-c5ea-4332-8a20-eca8e3d3843f" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 798.287895ms
11682024-11-28T04:52:39.967ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = f57349d0-1bf2-4527-8da5-5a20cc633ae7 response_code = 500 uri = /cockroachdb
11692024-11-28T04:52:39.967ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f57349d0-1bf2-4527-8da5-5a20cc633ae7", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f57349d0-1bf2-4527-8da5-5a20cc633ae7" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 401.610773ms
11702024-11-28T04:52:40.012ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55021
11712024-11-28T04:52:40.012ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55021 req_id = 0123dba1-b55c-476e-9fa8-5d0bbc05766a response_code = 200 uri = /baseboard
11722024-11-28T04:52:40.398ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3286dc7d-bcfc-40aa-b6a5-187747e3429e /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27510 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 410dc399-cc06-493e-bef0-15644d772cd4 response_code = 500 uri = /cockroachdb
11732024-11-28T04:52:40.398ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "410dc399-cc06-493e-bef0-15644d772cd4", "content-length": "124", "date": "Thu, 28 Nov 2024 04:52:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "410dc399-cc06-493e-bef0-15644d772cd4" } file = sled-agent/src/rack_setup/service.rs:1141 retry_after = 661.963506ms
11742024-11-28T04:52:41.093ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3743
11752024-11-28T04:52:55.026ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11762024-11-28T04:53:06.949ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11772024-11-28T04:53:06.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25886569 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39077 req_id = 91adb2d7-e9bc-4d1e-9055-b4e7cb6b22cb response_code = 204 uri = /cockroachdb
11782024-11-28T04:53:06.969ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 30.727598223s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
11792024-11-28T04:53:07.001ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 270afd5f-6723-45d0-939c-e46aa54e6cd0 (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2 (service), filesystem_pool: Some(ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6aeebbbf-d7fb-4df0-8468-d87378c9b306 (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1d5af9d6-ff84-4c5e-9c66-0e0d65161a8e, kind: Service { id: 6aeebbbf-d7fb-4df0-8468-d87378c9b306 }, name: Name("ntp-6aeebbbf-d7fb-4df0-8468-d87378c9b306"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 44])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: c0065690-4f77-48ae-8bca-b24f525a36ad (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } } } }, OmicronZoneConfig { id: ff691ffa-ed55-4af6-a133-e38607d5ea33 (service), filesystem_pool: Some(ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3286dc7d-bcfc-40aa-b6a5-187747e3429e (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External } } } }, OmicronZoneConfig { id: fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246 (service), filesystem_pool: Some(ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External } } } }, OmicronZoneConfig { id: cc77849b-ad20-4482-9b25-55ec332c16e4 (service), filesystem_pool: Some(ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5c8e639d-0b41-401f-a368-832f1887d4aa (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f (service), filesystem_pool: Some(ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 (service), filesystem_pool: Some(ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd (service), filesystem_pool: Some(ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6ce712fc-cbe1-4644-82df-17f7b29c618f (service), filesystem_pool: Some(ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: b3767df3-9f37-4f77-a2d7-14fb94521798 (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } } } }, OmicronZoneConfig { id: 01587ba0-922f-43f0-8c6b-21a2fe7a1b23 (service), filesystem_pool: Some(ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: a7daaeae-17b0-4016-88c0-aa16c8b3940f (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 297cbf5a-90f0-4773-9ceb-a3ebf606cd55 (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 5e9a8679-ccd3-4c68-88ca-20d35ef0478f (service), filesystem_pool: Some(ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External } } } }, OmicronZoneConfig { id: 875bb506-a584-49d7-a331-c58940f1a2da (service), filesystem_pool: Some(ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External } } } }, OmicronZoneConfig { id: 57deeb05-4f89-4df8-9328-ff78a6fc2d36 (service), filesystem_pool: Some(ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3ed6de4d-a187-41f8-baf9-679092ea755c (service), filesystem_pool: Some(ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External } } } }, OmicronZoneConfig { id: 2a20d415-5673-4768-88cc-70ee765539b3 (service), filesystem_pool: Some(ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7f70dac6-efe3-480f-857e-d49efff47f13 (service), filesystem_pool: Some(ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External } } } }, OmicronZoneConfig { id: 80007b4f-2e2f-4765-a1f9-35ee9b81983a (service), filesystem_pool: Some(ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External } } } }, OmicronZoneConfig { id: e156ace1-22a9-427b-8cc2-9ddfdf9cf27d (service), filesystem_pool: Some(ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a9a1a57-6f25-4e14-a0ff-6e976bb17db8 (service), filesystem_pool: Some(ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:525 sled_address = [fd00:1122:3344:101::1]:12345
11802024-11-28T04:53:07.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39304
11812024-11-28T04:53:07.002ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 270afd5f-6723-45d0-939c-e46aa54e6cd0, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11822024-11-28T04:53:07.002ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 270afd5f-6723-45d0-939c-e46aa54e6cd0, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11832024-11-28T04:53:07.052ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11842024-11-28T04:53:07.052ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 397d4fca-48c2-4546-a2f2-1a6b08a3c4e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11852024-11-28T04:53:07.093ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11862024-11-28T04:53:07.093ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 67da07c9-cebe-4b75-ae7c-47ee15182d8f, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11872024-11-28T04:53:07.136ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c0065690-4f77-48ae-8bca-b24f525a36ad, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11882024-11-28T04:53:07.136ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c0065690-4f77-48ae-8bca-b24f525a36ad, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11892024-11-28T04:53:07.180ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff691ffa-ed55-4af6-a133-e38607d5ea33, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11902024-11-28T04:53:07.180ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff691ffa-ed55-4af6-a133-e38607d5ea33, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11912024-11-28T04:53:07.221ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3286dc7d-bcfc-40aa-b6a5-187747e3429e, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11922024-11-28T04:53:07.221ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3286dc7d-bcfc-40aa-b6a5-187747e3429e, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11932024-11-28T04:53:07.264ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246, dataset_name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11942024-11-28T04:53:07.264ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fd3d3048-b7dc-40d1-8cd4-c6c1fcc79246, dataset_name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Cockroach }, responder: ... }
11952024-11-28T04:53:07.309ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc77849b-ad20-4482-9b25-55ec332c16e4, dataset_name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11962024-11-28T04:53:07.309ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cc77849b-ad20-4482-9b25-55ec332c16e4, dataset_name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11972024-11-28T04:53:07.354ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5c8e639d-0b41-401f-a368-832f1887d4aa, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11982024-11-28T04:53:07.354ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5c8e639d-0b41-401f-a368-832f1887d4aa, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11992024-11-28T04:53:07.397ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12002024-11-28T04:53:07.397ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12012024-11-28T04:53:07.439ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3767df3-9f37-4f77-a2d7-14fb94521798, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
12022024-11-28T04:53:07.439ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b3767df3-9f37-4f77-a2d7-14fb94521798, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12032024-11-28T04:53:07.482ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5e9a8679-ccd3-4c68-88ca-20d35ef0478f, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12042024-11-28T04:53:07.482ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5e9a8679-ccd3-4c68-88ca-20d35ef0478f, dataset_name: DatasetName { pool_name: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, kind: Crucible }, responder: ... }
12052024-11-28T04:53:07.520ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 875bb506-a584-49d7-a331-c58940f1a2da, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12062024-11-28T04:53:07.520ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 875bb506-a584-49d7-a331-c58940f1a2da, dataset_name: DatasetName { pool_name: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, kind: Crucible }, responder: ... }
12072024-11-28T04:53:07.560ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 57deeb05-4f89-4df8-9328-ff78a6fc2d36, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12082024-11-28T04:53:07.560ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 57deeb05-4f89-4df8-9328-ff78a6fc2d36, dataset_name: DatasetName { pool_name: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, kind: Crucible }, responder: ... }
12092024-11-28T04:53:07.602ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3ed6de4d-a187-41f8-baf9-679092ea755c, dataset_name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12102024-11-28T04:53:07.602ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3ed6de4d-a187-41f8-baf9-679092ea755c, dataset_name: DatasetName { pool_name: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, kind: Crucible }, responder: ... }
12112024-11-28T04:53:07.640ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2a20d415-5673-4768-88cc-70ee765539b3, dataset_name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12122024-11-28T04:53:07.640ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2a20d415-5673-4768-88cc-70ee765539b3, dataset_name: DatasetName { pool_name: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, kind: Crucible }, responder: ... }
12132024-11-28T04:53:07.686ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7f70dac6-efe3-480f-857e-d49efff47f13, dataset_name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12142024-11-28T04:53:07.686ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7f70dac6-efe3-480f-857e-d49efff47f13, dataset_name: DatasetName { pool_name: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, kind: Crucible }, responder: ... }
12152024-11-28T04:53:07.728ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 80007b4f-2e2f-4765-a1f9-35ee9b81983a, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12162024-11-28T04:53:07.728ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 80007b4f-2e2f-4765-a1f9-35ee9b81983a, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, kind: Crucible }, responder: ... }
12172024-11-28T04:53:07.770ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e156ace1-22a9-427b-8cc2-9ddfdf9cf27d, dataset_name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12182024-11-28T04:53:07.770ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e156ace1-22a9-427b-8cc2-9ddfdf9cf27d, dataset_name: DatasetName { pool_name: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, kind: Crucible }, responder: ... }
12192024-11-28T04:53:07.813ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7a9a1a57-6f25-4e14-a0ff-6e976bb17db8, dataset_name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12202024-11-28T04:53:07.813ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7a9a1a57-6f25-4e14-a0ff-6e976bb17db8, dataset_name: DatasetName { pool_name: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, kind: Crucible }, responder: ... }
12212024-11-28T04:53:07.854ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12222024-11-28T04:53:07.854ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
12232024-11-28T04:53:07.854ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
12242024-11-28T04:53:07.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12252024-11-28T04:53:07.960ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12262024-11-28T04:53:07.960ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12272024-11-28T04:53:07.995ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12282024-11-28T04:53:07.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12292024-11-28T04:53:07.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12302024-11-28T04:53:08.019ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12312024-11-28T04:53:08.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12322024-11-28T04:53:08.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12332024-11-28T04:53:08.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12342024-11-28T04:53:08.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12352024-11-28T04:53:08.200ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12362024-11-28T04:53:08.200ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12372024-11-28T04:53:08.239ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12382024-11-28T04:53:08.240ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12392024-11-28T04:53:08.240ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12402024-11-28T04:53:08.240ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12412024-11-28T04:53:08.240ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12422024-11-28T04:53:08.240ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12432024-11-28T04:53:08.241ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12442024-11-28T04:53:08.241ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23 file = illumos-utils/src/zone.rs:325
12452024-11-28T04:53:08.247ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f file = illumos-utils/src/zone.rs:325
12462024-11-28T04:53:08.253ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da file = illumos-utils/src/zone.rs:325
12472024-11-28T04:53:08.258ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c file = illumos-utils/src/zone.rs:325
12482024-11-28T04:53:08.264ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13 file = illumos-utils/src/zone.rs:325
12492024-11-28T04:53:08.270ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3 file = illumos-utils/src/zone.rs:325
12502024-11-28T04:53:08.276ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a file = illumos-utils/src/zone.rs:325
12512024-11-28T04:53:08.426ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23 file = illumos-utils/src/zone.rs:363
12522024-11-28T04:53:08.431ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f file = illumos-utils/src/zone.rs:363
12532024-11-28T04:53:08.436ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da file = illumos-utils/src/zone.rs:363
12542024-11-28T04:53:08.441ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c file = illumos-utils/src/zone.rs:363
12552024-11-28T04:53:08.446ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13 file = illumos-utils/src/zone.rs:363
12562024-11-28T04:53:08.451ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3 file = illumos-utils/src/zone.rs:363
12572024-11-28T04:53:08.456ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a file = illumos-utils/src/zone.rs:363
12582024-11-28T04:53:08.462ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798 file = illumos-utils/src/zone.rs:325
12592024-11-28T04:53:08.468ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55 file = illumos-utils/src/zone.rs:325
12602024-11-28T04:53:08.473ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f file = illumos-utils/src/zone.rs:325
12612024-11-28T04:53:08.479ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8 file = illumos-utils/src/zone.rs:325
12622024-11-28T04:53:08.484ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d file = illumos-utils/src/zone.rs:325
12632024-11-28T04:53:08.490ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36 file = illumos-utils/src/zone.rs:325
12642024-11-28T04:53:08.498ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f file = illumos-utils/src/zone.rs:325
12652024-11-28T04:53:08.506ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798 file = illumos-utils/src/zone.rs:363
12662024-11-28T04:53:08.514ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55 file = illumos-utils/src/zone.rs:363
12672024-11-28T04:53:08.524ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f file = illumos-utils/src/zone.rs:363
12682024-11-28T04:53:08.533ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8 file = illumos-utils/src/zone.rs:363
12692024-11-28T04:53:08.543ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d file = illumos-utils/src/zone.rs:363
12702024-11-28T04:53:08.553ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36 file = illumos-utils/src/zone.rs:363
12712024-11-28T04:53:08.575ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f file = illumos-utils/src/zone.rs:363
12722024-11-28T04:53:08.734ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12732024-11-28T04:53:08.808ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12742024-11-28T04:53:08.870ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12752024-11-28T04:53:08.934ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12762024-11-28T04:53:09.007ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12772024-11-28T04:53:09.022ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12782024-11-28T04:53:09.022ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12792024-11-28T04:53:09.080ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 185, 91]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12802024-11-28T04:53:09.081ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12812024-11-28T04:53:09.083ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12822024-11-28T04:53:09.083ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12832024-11-28T04:53:09.185ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 190, 206]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12842024-11-28T04:53:09.185ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12852024-11-28T04:53:09.186ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12862024-11-28T04:53:09.186ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12872024-11-28T04:53:09.252ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 244, 175]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12882024-11-28T04:53:09.252ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12892024-11-28T04:53:09.253ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12902024-11-28T04:53:09.253ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12912024-11-28T04:53:09.313ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 231, 164]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12922024-11-28T04:53:09.313ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12932024-11-28T04:53:09.315ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12942024-11-28T04:53:09.315ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12952024-11-28T04:53:09.375ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 149, 107]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12962024-11-28T04:53:09.375ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12972024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12982024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12992024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
13002024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
13012024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
13022024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
13032024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13042024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13052024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
13062024-11-28T04:53:09.386ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
13072024-11-28T04:53:09.405ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13082024-11-28T04:53:09.407ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13092024-11-28T04:53:09.409ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13102024-11-28T04:53:09.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13112024-11-28T04:53:09.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13122024-11-28T04:53:09.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13132024-11-28T04:53:09.412ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13142024-11-28T04:53:09.415ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13152024-11-28T04:53:09.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13162024-11-28T04:53:09.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13172024-11-28T04:53:09.641ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61 file = illumos-utils/src/zone.rs:325
13182024-11-28T04:53:09.651ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f file = illumos-utils/src/zone.rs:325
13192024-11-28T04:53:09.663ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 file = illumos-utils/src/zone.rs:325
13202024-11-28T04:53:09.674ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd file = illumos-utils/src/zone.rs:325
13212024-11-28T04:53:09.685ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa file = illumos-utils/src/zone.rs:325
13222024-11-28T04:53:09.698ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61 file = illumos-utils/src/zone.rs:363
13232024-11-28T04:53:09.708ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f file = illumos-utils/src/zone.rs:363
13242024-11-28T04:53:09.722ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 file = illumos-utils/src/zone.rs:363
13252024-11-28T04:53:09.733ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd file = illumos-utils/src/zone.rs:363
13262024-11-28T04:53:09.744ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa file = illumos-utils/src/zone.rs:363
13272024-11-28T04:53:10.254ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39983
13282024-11-28T04:53:10.256ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39983 req_id = ba2dfb9c-a845-4480-8e9e-2782c010eeca response_code = 200 uri = /baseboard
13292024-11-28T04:53:11.642ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e719a1be-6c13-42a5-a2a3-d0213e2593c1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13302024-11-28T04:53:11.642ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
13312024-11-28T04:53:11.651ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3abe6613-feef-46d1-ade9-21289cb9be78/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1793bf99-8ce9-4da6-86c6-897373120801'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322024-11-28T04:53:11.651ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2b59e6b4-e022-423c-8471-8bb373ed963e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13332024-11-28T04:53:11.651ZINFOSledAgent (ServiceManager): Booting oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
13342024-11-28T04:53:11.658ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
13352024-11-28T04:53:11.665ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_33949fdd-4265-4f10-ab58-a876a4529485/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8a234fd1-6c70-48c8-909e-36686dca80c9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13362024-11-28T04:53:11.665ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
13372024-11-28T04:53:11.674ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a9e98ecc-61d8-4c9b-8990-a5bf0079780d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13382024-11-28T04:53:11.674ZINFOSledAgent (ServiceManager): Booting oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
13392024-11-28T04:53:11.719ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='219692df-612d-4f96-a92f-d46c8e9aa0af'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13402024-11-28T04:53:11.719ZINFOSledAgent (ServiceManager): Booting oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
13412024-11-28T04:53:11.846ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6d55f79b-a83a-4d60-9a83-7025e3852f0c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422024-11-28T04:53:11.847ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
13432024-11-28T04:53:12.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 71.054788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
13442024-11-28T04:53:12.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 44.502493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
13452024-11-28T04:53:12.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 28.407968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
13462024-11-28T04:53:12.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 35.03622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
13472024-11-28T04:53:12.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 35.991684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
13482024-11-28T04:53:12.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 54.624117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
13492024-11-28T04:53:20.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 55.681612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
13502024-11-28T04:53:20.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 144.627065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
13512024-11-28T04:53:20.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 138.041767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
13522024-11-28T04:53:22.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 262.466215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
13532024-11-28T04:53:22.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 57.299866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
13542024-11-28T04:53:22.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 108.881604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
13552024-11-28T04:53:22.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 55.490484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
13562024-11-28T04:53:22.971ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572024-11-28T04:53:22.976ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='6ce712fc-cbe1-4644-82df-17f7b29c618f'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582024-11-28T04:53:23.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 283.114667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
13592024-11-28T04:53:23.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 42.913556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
13602024-11-28T04:53:23.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 211.79945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
13612024-11-28T04:53:23.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 264.79619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
13622024-11-28T04:53:23.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 195.828487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
13632024-11-28T04:53:23.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 136.968235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
13642024-11-28T04:53:23.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 284.909248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
13652024-11-28T04:53:23.125ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
13662024-11-28T04:53:23.135ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
13672024-11-28T04:53:23.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 143.127899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
13682024-11-28T04:53:23.157ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13692024-11-28T04:53:23.158ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
13702024-11-28T04:53:23.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 336.845338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
13712024-11-28T04:53:23.249ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13722024-11-28T04:53:23.249ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
13732024-11-28T04:53:23.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 272.439841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
13742024-11-28T04:53:23.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 475.20166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
13752024-11-28T04:53:23.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 278.436082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
13762024-11-28T04:53:23.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 189.833369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
13772024-11-28T04:53:23.327ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4f498487-c0df-4538-adab-e17b7773b517/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bb011770-6e6d-4401-9061-1f52ff4188fb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13782024-11-28T04:53:23.328ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
13792024-11-28T04:53:23.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 916.096449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
13802024-11-28T04:53:23.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 943.923237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
13812024-11-28T04:53:23.813ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c1ab70e5-120b-4db1-895c-564a6858dda1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2379caf6-3cd5-4303-b652-995d825659bc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13822024-11-28T04:53:23.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 383.847032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
13832024-11-28T04:53:23.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.191299113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
13842024-11-28T04:53:23.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 399.161273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
13852024-11-28T04:53:23.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 792.686616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
13862024-11-28T04:53:23.887ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13872024-11-28T04:53:23.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 593.643042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
13882024-11-28T04:53:23.903ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
13892024-11-28T04:53:23.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 38.07579ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
13902024-11-28T04:53:23.926ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
13912024-11-28T04:53:23.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 27.383705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
13922024-11-28T04:53:23.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 46.092965ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
13932024-11-28T04:53:23.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 83.215525ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
13942024-11-28T04:53:23.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 50.152228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
13952024-11-28T04:53:24.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 71.481524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
13962024-11-28T04:53:24.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 141.247898ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
13972024-11-28T04:53:24.033ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13982024-11-28T04:53:24.033ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13992024-11-28T04:53:24.033ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
14002024-11-28T04:53:24.044ZINFOSledAgent (ServiceManager): Booting oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
14012024-11-28T04:53:24.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 73.344476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
14022024-11-28T04:53:24.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 117.179536ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
14032024-11-28T04:53:24.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 214.596967ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
14042024-11-28T04:53:24.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 131.050129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
14052024-11-28T04:53:24.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 133.029775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
14062024-11-28T04:53:24.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 735.232872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
14072024-11-28T04:53:24.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 276.340517ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
14082024-11-28T04:53:24.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 1.166163527s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
14092024-11-28T04:53:24.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 513.186024ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
14102024-11-28T04:53:24.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 37.844069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
14112024-11-28T04:53:24.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 71.237702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
14122024-11-28T04:53:24.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 255.542369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
14132024-11-28T04:53:24.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 132.943607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
14142024-11-28T04:53:24.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 60.144444ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
14152024-11-28T04:53:24.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 65.525197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
14162024-11-28T04:53:24.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 277.251301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
14172024-11-28T04:53:24.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 899.840267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
14182024-11-28T04:53:24.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 52.523288ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
14192024-11-28T04:53:24.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 56.415224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
14202024-11-28T04:53:24.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 265.432629ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
14212024-11-28T04:53:24.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 495.35893ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
14222024-11-28T04:53:24.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 1.290458083s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
14232024-11-28T04:53:24.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 56.725612ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
14242024-11-28T04:53:24.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 568.213679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
14252024-11-28T04:53:24.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 240.207013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
14262024-11-28T04:53:24.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 1.226451871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
14272024-11-28T04:53:24.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 777.2373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
14282024-11-28T04:53:24.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 146.354348ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
14292024-11-28T04:53:24.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 206.579102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
14302024-11-28T04:53:24.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 749.245101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
14312024-11-28T04:53:24.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 127.62915ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
14322024-11-28T04:53:24.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 945.70466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
14332024-11-28T04:53:25.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.464500758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
14342024-11-28T04:53:25.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.112088187s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
14352024-11-28T04:53:25.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 865.421042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
14362024-11-28T04:53:25.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 431.857998ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
14372024-11-28T04:53:25.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 430.757987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
14382024-11-28T04:53:25.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 379.994824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
14392024-11-28T04:53:25.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 207.933599ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
14402024-11-28T04:53:25.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 568.043467ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
14412024-11-28T04:53:25.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 600.617507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
14422024-11-28T04:53:25.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 536.396574ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
14432024-11-28T04:53:25.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 937.237244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
14442024-11-28T04:53:25.504ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14452024-11-28T04:53:25.504ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
14462024-11-28T04:53:25.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.125800174s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
14472024-11-28T04:53:25.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 896.836526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
14482024-11-28T04:53:25.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.002147231s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
14492024-11-28T04:53:25.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 863.553239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
14502024-11-28T04:53:25.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 883.448659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
14512024-11-28T04:53:25.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 690.551645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
14522024-11-28T04:53:25.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 35.76673ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
14532024-11-28T04:53:25.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 126.740851ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
14542024-11-28T04:53:25.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.400528901s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
14552024-11-28T04:53:25.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 1.323204102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
14562024-11-28T04:53:25.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 170.842246ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
14572024-11-28T04:53:25.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 744.27678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
14582024-11-28T04:53:26.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 727.821651ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
14592024-11-28T04:53:26.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 769.705839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
14602024-11-28T04:53:26.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 933.976785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
14612024-11-28T04:53:26.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 985.244509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
14622024-11-28T04:53:26.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 452.320356ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
14632024-11-28T04:53:26.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.174824174s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
14642024-11-28T04:53:26.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.295001705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
14652024-11-28T04:53:26.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 884.968509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
14662024-11-28T04:53:26.459ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14672024-11-28T04:53:26.459ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
14682024-11-28T04:53:26.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.297375773s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
14692024-11-28T04:53:26.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 1.445512632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
14702024-11-28T04:53:26.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 1.011427849s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
14712024-11-28T04:53:26.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 881.871257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
14722024-11-28T04:53:26.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.146763667s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
14732024-11-28T04:53:26.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 969.286723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
14742024-11-28T04:53:26.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.407697541s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
14752024-11-28T04:53:26.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.479129743s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
14762024-11-28T04:53:26.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.156477784s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
14772024-11-28T04:53:26.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.375612808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
14782024-11-28T04:53:26.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 71.545013ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
14792024-11-28T04:53:27.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 101.493104ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
14802024-11-28T04:53:27.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 1.378657156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
14812024-11-28T04:53:27.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 1.355206141s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
14822024-11-28T04:53:27.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 289.862407ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
14832024-11-28T04:53:27.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 825.089518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
14842024-11-28T04:53:27.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.236000004s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
14852024-11-28T04:53:27.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 622.248155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
14862024-11-28T04:53:27.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 527.840388ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
14872024-11-28T04:53:27.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 427.460685ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
14882024-11-28T04:53:27.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 802.218954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
14892024-11-28T04:53:27.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 811.979082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
14902024-11-28T04:53:27.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.216720536s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
14912024-11-28T04:53:27.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 577.084821ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
14922024-11-28T04:53:27.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 621.881724ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
14932024-11-28T04:53:27.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.114667579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
14942024-11-28T04:53:27.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.095298523s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
14952024-11-28T04:53:27.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.11070008s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
14962024-11-28T04:53:27.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.314868728s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
14972024-11-28T04:53:27.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 555.227829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
14982024-11-28T04:53:28.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 1.036985668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
14992024-11-28T04:53:28.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 1.429654821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
15002024-11-28T04:53:28.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.249515349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
15012024-11-28T04:53:28.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.474442596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
15022024-11-28T04:53:28.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 625.979776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
15032024-11-28T04:53:28.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 726.279556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
15042024-11-28T04:53:28.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.488281636s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
15052024-11-28T04:53:28.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 1.264193353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
15062024-11-28T04:53:28.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.109457407s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
15072024-11-28T04:53:28.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 679.225087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
15082024-11-28T04:53:28.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 525.512206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
15092024-11-28T04:53:28.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 597.152124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
15102024-11-28T04:53:28.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.270129646s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
15112024-11-28T04:53:28.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.395952572s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
15122024-11-28T04:53:28.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 890.603499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
15132024-11-28T04:53:28.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 671.813629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
15142024-11-28T04:53:29.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.107456461s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
15152024-11-28T04:53:29.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 508.583738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
15162024-11-28T04:53:29.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 1.470116076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
15172024-11-28T04:53:29.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 633.123345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
15182024-11-28T04:53:29.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.338302698s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
15192024-11-28T04:53:29.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 1.373473359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
15202024-11-28T04:53:29.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 821.42598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
15212024-11-28T04:53:29.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.369701446s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
15222024-11-28T04:53:29.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.360325736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
15232024-11-28T04:53:29.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.303476876s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
15242024-11-28T04:53:29.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 863.377488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
15252024-11-28T04:53:29.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 769.311813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
15262024-11-28T04:53:29.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.078392613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
15272024-11-28T04:53:29.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 898.429811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
15282024-11-28T04:53:29.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.060714017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
15292024-11-28T04:53:29.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 612.982674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
15302024-11-28T04:53:29.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.346932801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
15312024-11-28T04:53:29.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 530.321415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
15322024-11-28T04:53:29.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.061538967s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
15332024-11-28T04:53:30.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 504.425755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
15342024-11-28T04:53:30.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.389862955s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
15352024-11-28T04:53:30.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 731.801776ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
15362024-11-28T04:53:30.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 853.893375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
15372024-11-28T04:53:30.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.039766374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
15382024-11-28T04:53:30.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 644.770258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
15392024-11-28T04:53:30.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.302935279s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
15402024-11-28T04:53:30.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 1.024035426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
15412024-11-28T04:53:30.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 1.394857854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
15422024-11-28T04:53:30.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 1.209389275s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
15432024-11-28T04:53:30.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 1.480518966s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
15442024-11-28T04:53:30.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 595.894759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
15452024-11-28T04:53:30.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 943.710684ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
15462024-11-28T04:53:30.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.474298118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
15472024-11-28T04:53:30.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.377686659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
15482024-11-28T04:53:30.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.469606482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
15492024-11-28T04:53:30.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 585.219636ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
15502024-11-28T04:53:30.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 901.602984ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
15512024-11-28T04:53:31.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.417167152s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
15522024-11-28T04:53:31.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 671.663649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
15532024-11-28T04:53:31.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 633.332302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
15542024-11-28T04:53:31.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 871.298879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
15552024-11-28T04:53:31.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 555.400918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
15562024-11-28T04:53:31.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 887.612287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
15572024-11-28T04:53:31.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 595.691894ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
15582024-11-28T04:53:31.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 1.414191501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
15592024-11-28T04:53:31.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 654.807687ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
15602024-11-28T04:53:31.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 516.049325ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
15612024-11-28T04:53:31.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 751.705391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
15622024-11-28T04:53:31.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.32732121s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
15632024-11-28T04:53:31.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 684.417218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
15642024-11-28T04:53:31.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 728.743396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
15652024-11-28T04:53:31.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.398098364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
15662024-11-28T04:53:31.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.166399667s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
15672024-11-28T04:53:31.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 866.867281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
15682024-11-28T04:53:32.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 920.3022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
15692024-11-28T04:53:32.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 876.272923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
15702024-11-28T04:53:32.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.242017014s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
15712024-11-28T04:53:32.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 951.08809ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
15722024-11-28T04:53:32.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 535.050039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
15732024-11-28T04:53:32.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.137135451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
15742024-11-28T04:53:32.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 538.267935ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
15752024-11-28T04:53:32.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.172993575s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
15762024-11-28T04:53:32.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 717.635789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
15772024-11-28T04:53:32.415ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15782024-11-28T04:53:32.455ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
15792024-11-28T04:53:32.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 959.778553ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
15802024-11-28T04:53:32.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 809.576887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
15812024-11-28T04:53:32.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 654.578113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
15822024-11-28T04:53:32.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 865.578473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
15832024-11-28T04:53:32.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.26867954s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
15842024-11-28T04:53:32.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 630.65677ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
15852024-11-28T04:53:32.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 66.515213ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
15862024-11-28T04:53:32.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 805.261302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
15872024-11-28T04:53:32.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 63.625817ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
15882024-11-28T04:53:32.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 774.734126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
15892024-11-28T04:53:33.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 1.217691621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
15902024-11-28T04:53:33.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 248.962221ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
15912024-11-28T04:53:33.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 849.561467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
15922024-11-28T04:53:33.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 957.955972ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
15932024-11-28T04:53:33.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.188581868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
15942024-11-28T04:53:33.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 534.921561ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
15952024-11-28T04:53:33.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 813.885995ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
15962024-11-28T04:53:33.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 734.972499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
15972024-11-28T04:53:33.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.271569877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
15982024-11-28T04:53:33.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 578.291105ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
15992024-11-28T04:53:33.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 795.325991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
16002024-11-28T04:53:33.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 862.547356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
16012024-11-28T04:53:33.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 539.065925ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
16022024-11-28T04:53:33.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 1.016780669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
16032024-11-28T04:53:33.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.185886558s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
16042024-11-28T04:53:33.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.266325275s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
16052024-11-28T04:53:33.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.128930167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
16062024-11-28T04:53:33.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.246388523s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
16072024-11-28T04:53:33.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 825.906852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
16082024-11-28T04:53:33.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 560.807494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
16092024-11-28T04:53:33.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 634.567675ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
16102024-11-28T04:53:33.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 963.163762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
16112024-11-28T04:53:33.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 1.349101042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
16122024-11-28T04:53:33.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.331011357s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
16132024-11-28T04:53:33.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.32962444s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
16142024-11-28T04:53:34.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 769.413014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
16152024-11-28T04:53:34.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 831.277967ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
16162024-11-28T04:53:34.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 1.023011683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
16172024-11-28T04:53:34.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 1.159205437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
16182024-11-28T04:53:34.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 602.820738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
16192024-11-28T04:53:34.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.332937131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
16202024-11-28T04:53:34.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 737.476455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
16212024-11-28T04:53:34.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 887.194112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
16222024-11-28T04:53:34.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 1.339521689s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
16232024-11-28T04:53:34.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 765.39512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
16242024-11-28T04:53:34.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 963.004921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
16252024-11-28T04:53:34.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 952.678259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
16262024-11-28T04:53:34.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.381594821s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
16272024-11-28T04:53:34.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.363415635s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
16282024-11-28T04:53:34.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.021093382s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
16292024-11-28T04:53:34.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 1.151890437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
16302024-11-28T04:53:34.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 834.136112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
16312024-11-28T04:53:34.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.307350585s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
16322024-11-28T04:53:34.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 810.512249ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
16332024-11-28T04:53:35.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 1.281143755s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
16342024-11-28T04:53:35.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 561.50909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
16352024-11-28T04:53:35.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.003722335s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
16362024-11-28T04:53:35.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 747.165805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
16372024-11-28T04:53:35.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.437033812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
16382024-11-28T04:53:35.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.137563985s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
16392024-11-28T04:53:35.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 1.423671081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
16402024-11-28T04:53:35.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 842.961821ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
16412024-11-28T04:53:35.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 984.845273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
16422024-11-28T04:53:35.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.149787363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
16432024-11-28T04:53:35.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.463536977s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
16442024-11-28T04:53:35.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.307956806s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
16452024-11-28T04:53:35.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 813.095801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
16462024-11-28T04:53:35.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 784.093834ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
16472024-11-28T04:53:35.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.344442279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
16482024-11-28T04:53:35.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 1.366162214s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
16492024-11-28T04:53:36.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 581.206432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
16502024-11-28T04:53:36.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.413992412s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
16512024-11-28T04:53:36.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 1.286984692s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
16522024-11-28T04:53:36.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.124087144s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
16532024-11-28T04:53:36.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.160784612s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
16542024-11-28T04:53:36.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 1.459926739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
16552024-11-28T04:53:36.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.344048605s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
16562024-11-28T04:53:36.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 701.801139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
16572024-11-28T04:53:36.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.380736675s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
16582024-11-28T04:53:36.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 714.937159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
16592024-11-28T04:53:36.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.480355328s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
16602024-11-28T04:53:36.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 636.775265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
16612024-11-28T04:53:36.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 721.043945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
16622024-11-28T04:53:36.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.143585279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
16632024-11-28T04:53:36.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.184954645s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
16642024-11-28T04:53:36.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 1.013102064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
16652024-11-28T04:53:37.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 814.252869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
16662024-11-28T04:53:37.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 969.596571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
16672024-11-28T04:53:37.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 588.25383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
16682024-11-28T04:53:37.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.18226975s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
16692024-11-28T04:53:37.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 1.231621128s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
16702024-11-28T04:53:37.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 609.644774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
16712024-11-28T04:53:37.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 1.410526576s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
16722024-11-28T04:53:37.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 997.331126ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
16732024-11-28T04:53:37.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 832.054272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
16742024-11-28T04:53:37.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 1.130759589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
16752024-11-28T04:53:37.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 564.617928ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
16762024-11-28T04:53:37.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.296883692s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
16772024-11-28T04:53:37.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 848.167837ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
16782024-11-28T04:53:37.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 1.485979091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
16792024-11-28T04:53:37.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.212936979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
16802024-11-28T04:53:37.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 761.803234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
16812024-11-28T04:53:37.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 1.373678203s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
16822024-11-28T04:53:37.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.370873133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
16832024-11-28T04:53:37.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.011136951s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
16842024-11-28T04:53:37.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 944.927991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
16852024-11-28T04:53:37.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 757.028927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
16862024-11-28T04:53:37.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.26646772s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
16872024-11-28T04:53:38.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.094822555s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
16882024-11-28T04:53:38.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 614.852491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
16892024-11-28T04:53:38.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 1.391118802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
16902024-11-28T04:53:38.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.086936019s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
16912024-11-28T04:53:38.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 904.360061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
16922024-11-28T04:53:38.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 1.000460665s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
16932024-11-28T04:53:38.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 504.686109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
16942024-11-28T04:53:38.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 578.209738ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
16952024-11-28T04:53:38.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 1.497796883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
16962024-11-28T04:53:38.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 1.477345841s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
16972024-11-28T04:53:38.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 1.231845743s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
16982024-11-28T04:53:38.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 609.92459ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
16992024-11-28T04:53:38.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.137887013s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
17002024-11-28T04:53:38.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.008715178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
17012024-11-28T04:53:38.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 539.468144ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
17022024-11-28T04:53:38.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 529.534143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
17032024-11-28T04:53:39.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.161704291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
17042024-11-28T04:53:39.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.23984891s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
17052024-11-28T04:53:39.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 619.980714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
17062024-11-28T04:53:39.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.462630603s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
17072024-11-28T04:53:39.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 1.493466535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
17082024-11-28T04:53:39.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 802.99503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
17092024-11-28T04:53:39.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 973.572726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
17102024-11-28T04:53:39.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 816.979875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
17112024-11-28T04:53:39.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 821.607496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
17122024-11-28T04:53:39.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 772.122966ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
17132024-11-28T04:53:39.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.149456139s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
17142024-11-28T04:53:39.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13") failed: Property not found. retry in 1.452777891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
17152024-11-28T04:53:39.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 708.321155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
17162024-11-28T04:53:39.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 1.072216172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
17172024-11-28T04:53:39.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 920.984733ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
17182024-11-28T04:53:39.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 972.317082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
17192024-11-28T04:53:39.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.424539786s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
17202024-11-28T04:53:39.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 1.058245157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
17212024-11-28T04:53:40.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 531.127605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
17222024-11-28T04:53:40.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 660.212853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
17232024-11-28T04:53:40.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 502.583646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
17242024-11-28T04:53:40.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.443336453s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
17252024-11-28T04:53:40.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 1.142756337s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17262024-11-28T04:53:40.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.162752823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
17272024-11-28T04:53:40.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.434756239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
17282024-11-28T04:53:40.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 841.364131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
17292024-11-28T04:53:40.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 736.698396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
17302024-11-28T04:53:40.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 934.572142ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
17312024-11-28T04:53:40.338ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56950
17322024-11-28T04:53:40.350ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1127 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56950 req_id = fec067f2-8766-4cf6-912e-a193484d05a7 response_code = 200 uri = /baseboard
17332024-11-28T04:53:40.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 651.486889ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
17342024-11-28T04:53:40.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a") failed: Property not found. retry in 1.024568505s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
17352024-11-28T04:53:40.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 758.800569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
17362024-11-28T04:53:40.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 668.241065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
17372024-11-28T04:53:40.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 1.070544966s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
17382024-11-28T04:53:40.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 1.092430976s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
17392024-11-28T04:53:40.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 675.242296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
17402024-11-28T04:53:40.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d") failed: Property not found. retry in 855.39563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
17412024-11-28T04:53:40.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 638.031147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
17422024-11-28T04:53:40.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f") failed: Property not found. retry in 1.466908935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
17432024-11-28T04:53:41.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3") failed: Property not found. retry in 1.47838596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
17442024-11-28T04:53:41.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 697.231877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
17452024-11-28T04:53:41.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 972.034945ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
17462024-11-28T04:53:41.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 868.993929ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
17472024-11-28T04:53:41.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 557.295069ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17482024-11-28T04:53:41.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8") failed: Property not found. retry in 1.465338488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
17492024-11-28T04:53:41.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 863.36295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
17502024-11-28T04:53:41.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 934.843044ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
17512024-11-28T04:53:41.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 566.722005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
17522024-11-28T04:53:41.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23") failed: Property not found. retry in 1.445571073s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
17532024-11-28T04:53:41.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 546.076921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
17542024-11-28T04:53:41.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.000827804s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
17552024-11-28T04:53:41.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55") failed: Property not found. retry in 1.108131397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
17562024-11-28T04:53:41.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9") failed: Property not found. retry in 926.403378ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
17572024-11-28T04:53:41.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f") failed: Property not found. retry in 604.560603ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
17582024-11-28T04:53:41.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36") failed: Property not found. retry in 614.321436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
17592024-11-28T04:53:41.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 935.355061ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17602024-11-28T04:53:41.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c") failed: Property not found. retry in 1.236364006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
17612024-11-28T04:53:42.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f") failed: Property not found. retry in 1.39947909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
17622024-11-28T04:53:42.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa") failed: Property not found. retry in 1.471434645s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
17632024-11-28T04:53:42.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da") failed: Property not found. retry in 1.006430934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
17642024-11-28T04:53:42.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f") failed: Property not found. retry in 1.32330759s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
17652024-11-28T04:53:42.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61") failed: Property not found. retry in 1.144036684s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
17662024-11-28T04:53:42.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd") failed: Property not found. retry in 1.312071479s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
17672024-11-28T04:53:42.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 987.029969ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17682024-11-28T04:53:43.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 1.184860168s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17692024-11-28T04:53:45.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 1.199730898s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17702024-11-28T04:53:46.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 566.294861ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17712024-11-28T04:53:46.752ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 38.015350842s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
17722024-11-28T04:53:46.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798") failed: Property not found. retry in 1.444989479s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17732024-11-28T04:53:46.937ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
17742024-11-28T04:53:46.938ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/nexus.rs:527 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
17752024-11-28T04:53:47.152ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/nexus.rs:527 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
17762024-11-28T04:53:47.939ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
17772024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_01587ba0-922f-43f0-8c6b-21a2fe7a1b23
17782024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_ae5f89dc-ceae-4347-960d-bb4e54db9bbd
17792024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_5e9a8679-ccd3-4c68-88ca-20d35ef0478f
17802024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_875bb506-a584-49d7-a331-c58940f1a2da
17812024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_5c8e639d-0b41-401f-a368-832f1887d4aa
17822024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_3ed6de4d-a187-41f8-baf9-679092ea755c
17832024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_7f70dac6-efe3-480f-857e-d49efff47f13
17842024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_3f1b2e0e-2187-48c9-9a08-167823db7b61
17852024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_2a20d415-5673-4768-88cc-70ee765539b3
17862024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_80007b4f-2e2f-4765-a1f9-35ee9b81983a
17872024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_b3767df3-9f37-4f77-a2d7-14fb94521798
17882024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_91d815d7-9afa-45d8-a0f1-9deeaae8e60f
17892024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_297cbf5a-90f0-4773-9ceb-a3ebf606cd55
17902024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_6ce712fc-cbe1-4644-82df-17f7b29c618f
17912024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_7a9a1a57-6f25-4e14-a0ff-6e976bb17db8
17922024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e156ace1-22a9-427b-8cc2-9ddfdf9cf27d
17932024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_57deeb05-4f89-4df8-9328-ff78a6fc2d36
17942024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_15c048e4-d934-4eb6-8bed-d5adc0f1a1b9
17952024-11-28T04:53:48.275ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_a7daaeae-17b0-4016-88c0-aa16c8b3940f
17962024-11-28T04:53:48.276ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17972024-11-28T04:53:48.284ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17982024-11-28T04:53:48.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41285383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39304 req_id = 8fdda4ce-4a84-4550-895d-6c4856ac25d3 response_code = 204 uri = /omicron-zones
17992024-11-28T04:53:48.303ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1435
18002024-11-28T04:53:48.303ZINFOSledAgent (RSS): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18012024-11-28T04:53:48.303ZINFOSledAgent (RSS): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18022024-11-28T04:53:48.306ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:774
18032024-11-28T04:53:48.308ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:786
18042024-11-28T04:53:48.340ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1000
18052024-11-28T04:53:48.351ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18062024-11-28T04:53:48.445ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18072024-11-28T04:53:48.614ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18082024-11-28T04:53:48.739ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18092024-11-28T04:53:48.862ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18102024-11-28T04:53:48.942ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
18112024-11-28T04:53:49.008ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18122024-11-28T04:53:49.044ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/nexus.rs:527 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
18132024-11-28T04:53:49.152ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18142024-11-28T04:53:49.596ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18152024-11-28T04:53:49.945ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e95a4636-3865-437f-b2db-2549d48485b1) file = sled-agent/src/probe_manager.rs:231 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
18162024-11-28T04:53:50.071ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1062
18172024-11-28T04:53:52.251ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "46156b54-8e4a-4ece-a053-c6892c38ec39", "content-length": "173", "date": "Thu, 28 Nov 2024 04:53:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632\"", request_id: "46156b54-8e4a-4ece-a053-c6892c38ec39" } file = sled-agent/src/rack_setup/service.rs:1062
18182024-11-28T04:53:52.990ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d2fcaca4-2400-448d-b39d-ffcba48e10ae", "content-length": "173", "date": "Thu, 28 Nov 2024 04:53:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632\"", request_id: "d2fcaca4-2400-448d-b39d-ffcba48e10ae" } file = sled-agent/src/rack_setup/service.rs:1062
18192024-11-28T04:53:53.212ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
18202024-11-28T04:53:53.496ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "991d0dd9-7ba4-425a-aa71-73fe6c0e0ea0", "content-length": "173", "date": "Thu, 28 Nov 2024 04:53:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cd43b0bc-0f5d-4fc8-a265-1fbf2ffc3632\"", request_id: "991d0dd9-7ba4-425a-aa71-73fe6c0e0ea0" } file = sled-agent/src/rack_setup/service.rs:1062
18212024-11-28T04:53:54.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50745
18222024-11-28T04:53:54.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1536 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50745 req_id = 699085b4-03e6-41c5-99c3-cd19b76f4e15 response_code = 200 uri = /vpc-routes
18232024-11-28T04:53:54.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61351
18242024-11-28T04:53:54.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61351 req_id = 449c409b-7d03-4eba-9f5e-3140d8f5c286 response_code = 200 uri = /vpc-routes
18252024-11-28T04:53:54.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37383
18262024-11-28T04:53:54.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37383 req_id = 9026783c-7e84-4caa-99d5-1f248f32e800 response_code = 200 uri = /vpc-routes
18272024-11-28T04:53:54.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36352
18282024-11-28T04:53:54.876ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18292024-11-28T04:53:54.876ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18302024-11-28T04:53:54.876ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
18312024-11-28T04:53:54.877ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
18322024-11-28T04:53:54.894ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18332024-11-28T04:53:54.894ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f498487-c0df-4538-adab-e17b7773b517
18342024-11-28T04:53:54.925ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18352024-11-28T04:53:54.925ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3abe6613-feef-46d1-ade9-21289cb9be78
18362024-11-28T04:53:54.938ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
18372024-11-28T04:53:54.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8945 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61351 req_id = a636a780-debe-4852-bf57-b75c60a9a09a response_code = 204 uri = /eip-gateways
18382024-11-28T04:53:54.940ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
18392024-11-28T04:53:54.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 614 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50745 req_id = d72f42fc-7769-4440-aadd-aac681c0b974 response_code = 204 uri = /eip-gateways
18402024-11-28T04:53:54.940ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
18412024-11-28T04:53:54.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37383 req_id = 9af77bf1-ab4c-4de8-8f46-71972df645b7 response_code = 204 uri = /eip-gateways
18422024-11-28T04:53:54.955ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18432024-11-28T04:53:54.955ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9
18442024-11-28T04:53:54.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46770
18452024-11-28T04:53:54.979ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18462024-11-28T04:53:54.979ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18472024-11-28T04:53:54.979ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
18482024-11-28T04:53:54.979ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
18492024-11-28T04:53:54.983ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18502024-11-28T04:53:54.983ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf
18512024-11-28T04:53:54.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44245
18522024-11-28T04:53:55.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18532024-11-28T04:53:55.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18542024-11-28T04:53:55.000ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18552024-11-28T04:53:55.000ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f498487-c0df-4538-adab-e17b7773b517
18562024-11-28T04:53:55.000ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
18572024-11-28T04:53:55.010ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
18582024-11-28T04:53:55.023ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18592024-11-28T04:53:55.023ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c1ab70e5-120b-4db1-895c-564a6858dda1
18602024-11-28T04:53:55.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52428
18612024-11-28T04:53:55.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52428 req_id = b8d97645-18b6-4c71-a3ec-97d05e1f8186 response_code = 200 uri = /v2p
18622024-11-28T04:53:55.045ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18632024-11-28T04:53:55.045ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f498487-c0df-4538-adab-e17b7773b517
18642024-11-28T04:53:55.067ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18652024-11-28T04:53:55.067ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3abe6613-feef-46d1-ade9-21289cb9be78
18662024-11-28T04:53:55.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62392
18672024-11-28T04:53:55.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62392 req_id = 81819bfc-d6ad-47aa-ac1c-63f0f68fb7f7 response_code = 200 uri = /v2p
18682024-11-28T04:53:55.090ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18692024-11-28T04:53:55.090ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc
18702024-11-28T04:53:55.106ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18712024-11-28T04:53:55.106ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3abe6613-feef-46d1-ade9-21289cb9be78
18722024-11-28T04:53:55.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58281
18732024-11-28T04:53:55.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58281 req_id = 48a39984-3397-4c23-9993-8dd64f17b8e1 response_code = 200 uri = /v2p
18742024-11-28T04:53:55.122ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18752024-11-28T04:53:55.122ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9
18762024-11-28T04:53:55.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5802 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37383 req_id = 5232f855-f11c-4e28-a9a9-8457c920eb55 response_code = 204 uri = /vpc-routes
18772024-11-28T04:53:55.139ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18782024-11-28T04:53:55.139ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad
18792024-11-28T04:53:55.149ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
18802024-11-28T04:53:55.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5415 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50745 req_id = 24aa5b5f-4a06-446f-af29-0163304126f4 response_code = 204 uri = /vpc-routes
18812024-11-28T04:53:55.149ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
18822024-11-28T04:53:55.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61351 req_id = 19ae6866-98dd-47a4-b097-1014f853f162 response_code = 204 uri = /vpc-routes
18832024-11-28T04:53:55.155ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18842024-11-28T04:53:55.155ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9
18852024-11-28T04:53:55.173ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18862024-11-28T04:53:55.173ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf
18872024-11-28T04:53:55.187ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18882024-11-28T04:53:55.187ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b
18892024-11-28T04:53:55.201ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18902024-11-28T04:53:55.201ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf
18912024-11-28T04:53:55.216ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18922024-11-28T04:53:55.216ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c1ab70e5-120b-4db1-895c-564a6858dda1
18932024-11-28T04:53:55.230ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18942024-11-28T04:53:55.230ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33949fdd-4265-4f10-ab58-a876a4529485
18952024-11-28T04:53:55.243ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18962024-11-28T04:53:55.243ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c1ab70e5-120b-4db1-895c-564a6858dda1
18972024-11-28T04:53:55.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372444 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36352 req_id = 89bc8de3-aa78-408e-a14b-26504fc84739 response_code = 200 uri = /inventory
18982024-11-28T04:53:55.258ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18992024-11-28T04:53:55.258ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc
19002024-11-28T04:53:55.274ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19012024-11-28T04:53:55.274ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc
19022024-11-28T04:53:55.288ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19032024-11-28T04:53:55.288ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad
19042024-11-28T04:53:55.312ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19052024-11-28T04:53:55.312ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b
19062024-11-28T04:53:55.325ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19072024-11-28T04:53:55.325ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad
19082024-11-28T04:53:55.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19092024-11-28T04:53:55.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33949fdd-4265-4f10-ab58-a876a4529485
19102024-11-28T04:53:55.355ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19112024-11-28T04:53:55.355ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b
19122024-11-28T04:53:55.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 393902 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46770 req_id = df61447b-c7fc-4733-aa39-de852df9407f response_code = 200 uri = /inventory
19132024-11-28T04:53:55.380ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19142024-11-28T04:53:55.380ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33949fdd-4265-4f10-ab58-a876a4529485
19152024-11-28T04:53:55.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44245 req_id = 35079499-612a-48ef-a52b-48a5e79d9158 response_code = 200 uri = /inventory
19162024-11-28T04:53:56.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48750
19172024-11-28T04:53:56.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19182024-11-28T04:53:56.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19192024-11-28T04:53:56.287ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
19202024-11-28T04:53:56.287ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
19212024-11-28T04:53:56.298ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19222024-11-28T04:53:56.298ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f498487-c0df-4538-adab-e17b7773b517
19232024-11-28T04:53:56.322ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19242024-11-28T04:53:56.322ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3abe6613-feef-46d1-ade9-21289cb9be78
19252024-11-28T04:53:56.342ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19262024-11-28T04:53:56.342ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9
19272024-11-28T04:53:56.365ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19282024-11-28T04:53:56.365ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf
19292024-11-28T04:53:56.386ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19302024-11-28T04:53:56.386ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c1ab70e5-120b-4db1-895c-564a6858dda1
19312024-11-28T04:53:56.407ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19322024-11-28T04:53:56.407ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc
19332024-11-28T04:53:56.429ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19342024-11-28T04:53:56.429ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad
19352024-11-28T04:53:56.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64621
19362024-11-28T04:53:56.449ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19372024-11-28T04:53:56.449ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b
19382024-11-28T04:53:56.454ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19392024-11-28T04:53:56.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19402024-11-28T04:53:56.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19412024-11-28T04:53:56.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19422024-11-28T04:53:56.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19432024-11-28T04:53:56.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19442024-11-28T04:53:56.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19452024-11-28T04:53:56.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64621 req_id = 48925457-2c78-45d7-b3df-50a369fd2e2d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19462024-11-28T04:53:56.456ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1072
19472024-11-28T04:53:56.475ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19482024-11-28T04:53:56.475ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33949fdd-4265-4f10-ab58-a876a4529485
19492024-11-28T04:53:56.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48750 req_id = 78b9d66d-aa4a-4322-afbb-4594602ee7a9 response_code = 200 uri = /inventory
19502024-11-28T04:53:56.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35109
19512024-11-28T04:53:56.874ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19522024-11-28T04:53:56.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19532024-11-28T04:53:56.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19542024-11-28T04:53:56.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19552024-11-28T04:53:56.875ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19562024-11-28T04:53:56.875ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19572024-11-28T04:53:56.875ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19582024-11-28T04:53:56.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35109 req_id = d09ca447-05a6-45fe-abdf-35cff008d8be response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19592024-11-28T04:53:56.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62485
19602024-11-28T04:53:56.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19612024-11-28T04:53:56.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19622024-11-28T04:53:56.877ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
19632024-11-28T04:53:56.884ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
19642024-11-28T04:53:56.896ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19652024-11-28T04:53:56.896ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f498487-c0df-4538-adab-e17b7773b517
19662024-11-28T04:53:56.923ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19672024-11-28T04:53:56.923ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3abe6613-feef-46d1-ade9-21289cb9be78
19682024-11-28T04:53:56.948ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19692024-11-28T04:53:56.948ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9
19702024-11-28T04:53:56.974ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19712024-11-28T04:53:56.974ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf
19722024-11-28T04:53:56.998ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19732024-11-28T04:53:56.998ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c1ab70e5-120b-4db1-895c-564a6858dda1
19742024-11-28T04:53:57.021ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19752024-11-28T04:53:57.022ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc
19762024-11-28T04:53:57.044ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19772024-11-28T04:53:57.044ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad
19782024-11-28T04:53:57.066ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19792024-11-28T04:53:57.066ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b
19802024-11-28T04:53:57.089ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19812024-11-28T04:53:57.089ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33949fdd-4265-4f10-ab58-a876a4529485
19822024-11-28T04:53:57.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225544 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62485 req_id = 1c0f18b6-8984-4640-a3fa-527a29d61ac9 response_code = 200 uri = /inventory
19832024-11-28T04:53:57.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52920
19842024-11-28T04:53:57.268ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19852024-11-28T04:53:57.268ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19862024-11-28T04:53:57.268ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19872024-11-28T04:53:57.268ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19882024-11-28T04:53:57.268ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19892024-11-28T04:53:57.268ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19902024-11-28T04:53:57.268ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19912024-11-28T04:53:57.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52920 req_id = 7f2fd3af-15fa-4c17-8d23-2edd8701f9b5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19922024-11-28T04:53:57.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55290
19932024-11-28T04:53:57.649ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19942024-11-28T04:53:57.649ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19952024-11-28T04:53:57.649ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19962024-11-28T04:53:57.649ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19972024-11-28T04:53:57.649ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19982024-11-28T04:53:57.649ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19992024-11-28T04:53:57.649ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20002024-11-28T04:53:57.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55290 req_id = f200ca01-6a49-4dac-8de6-a646d7d83eea response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20012024-11-28T04:54:02.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43056
20022024-11-28T04:54:02.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43056 req_id = 41010ab8-3d5d-43d0-a482-39c5e3de637a response_code = 200 uri = /vpc-routes
20032024-11-28T04:54:02.081ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
20042024-11-28T04:54:02.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43056 req_id = d78bcd11-e472-42cb-abe3-46a1d558037f response_code = 204 uri = /eip-gateways
20052024-11-28T04:54:02.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43056 req_id = 680865cf-18b3-41db-9fb3-6030938b73fa response_code = 204 uri = /vpc-routes
20062024-11-28T04:54:10.425ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45416
20072024-11-28T04:54:10.426ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45416 req_id = d2e670dd-7787-4760-8dca-a4a349e5274a response_code = 200 uri = /baseboard
20082024-11-28T04:54:24.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33766
20092024-11-28T04:54:24.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33766 req_id = f7082e30-d581-4324-9554-9b67fbede0fc response_code = 200 uri = /vpc-routes
20102024-11-28T04:54:24.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37332
20112024-11-28T04:54:24.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37332 req_id = b41da76b-6d14-4ae5-98aa-34102740a155 response_code = 200 uri = /vpc-routes
20122024-11-28T04:54:24.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56666
20132024-11-28T04:54:24.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56666 req_id = 1a4c758f-a53d-486e-8d7b-403f95390fd1 response_code = 200 uri = /v2p
20142024-11-28T04:54:24.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
20152024-11-28T04:54:24.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33766 req_id = b06386da-91db-4479-9882-35c976c83ab2 response_code = 204 uri = /eip-gateways
20162024-11-28T04:54:24.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33766 req_id = 04631581-1863-4dac-adcb-3c473ebe58d2 response_code = 204 uri = /vpc-routes
20172024-11-28T04:54:24.736ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
20182024-11-28T04:54:24.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37332 req_id = 3fc8575c-cbe3-4220-9ca2-1b2cc6e4b6bc response_code = 204 uri = /eip-gateways
20192024-11-28T04:54:24.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37332 req_id = 6c06d65e-abdb-4787-a8e8-053d083e0228 response_code = 204 uri = /vpc-routes
20202024-11-28T04:54:24.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64973
20212024-11-28T04:54:24.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64973 req_id = fdb817b4-88cd-4b30-ab17-f31b6771100b response_code = 200 uri = /v2p
20222024-11-28T04:54:24.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43533
20232024-11-28T04:54:24.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43533 req_id = 7b24a57b-073e-4672-ad90-fa9feb659389 response_code = 200 uri = /vpc-routes
20242024-11-28T04:54:24.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62534
20252024-11-28T04:54:24.848ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20262024-11-28T04:54:24.932ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20272024-11-28T04:54:25.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62534 req_id = 862187a0-9daa-4459-ae82-2f57408300e8 response_code = 204 uri = /switch-ports
20282024-11-28T04:54:25.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39047
20292024-11-28T04:54:25.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42489
20302024-11-28T04:54:25.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
20312024-11-28T04:54:25.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43533 req_id = 1cbea39a-2b4f-4edb-a3f2-2b80e012c3dc response_code = 204 uri = /eip-gateways
20322024-11-28T04:54:25.000ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20332024-11-28T04:54:25.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6730 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62534 req_id = 9604ae42-0fab-414e-8e34-3bd5300887a1 response_code = 200 uri = /network-bootstore-config
20342024-11-28T04:54:25.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6636 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42489 req_id = 4297590c-fbfe-4105-9fda-40eb6e3383e0 response_code = 200 uri = /v2p
20352024-11-28T04:54:25.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43533 req_id = d91d34fc-e3e0-4c95-8936-87e2b36292f4 response_code = 204 uri = /vpc-routes
20362024-11-28T04:54:25.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40619
20372024-11-28T04:54:25.050ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20382024-11-28T04:54:25.070ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
20392024-11-28T04:54:25.071ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20402024-11-28T04:54:25.072ZINFOSledAgent (bootstore): Writing ledger to /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20412024-11-28T04:54:25.073ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
20422024-11-28T04:54:25.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5845 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62534 req_id = 4f42fb17-3410-4b6c-9c49-1f6e224dee35 response_code = 204 uri = /network-bootstore-config
20432024-11-28T04:54:25.112ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20442024-11-28T04:54:25.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112224 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39047 req_id = f811e034-a151-4d3d-b1ee-fb8c6a6e7e14 response_code = 204 uri = /switch-ports
20452024-11-28T04:54:25.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 451 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39047 req_id = e386ed2d-6e0c-4529-836e-f33e9216b880 response_code = 200 uri = /network-bootstore-config
20462024-11-28T04:54:25.146ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20472024-11-28T04:54:25.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178771 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40619 req_id = 9fe1a383-bbd0-4adf-8ee0-608f79fac50f response_code = 204 uri = /switch-ports
20482024-11-28T04:54:25.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40619 req_id = 24375d09-6bdf-4550-a549-b64b60a86668 response_code = 200 uri = /network-bootstore-config
20492024-11-28T04:54:36.637ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:57603 remote_addr = [fd00:1122:3344:101::d]:36983 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
20502024-11-28T04:54:36.663ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24909 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 46d88034-65fa-4a2c-a4a3-710b2663d608 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
20512024-11-28T04:54:40.460ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42933
20522024-11-28T04:54:40.461ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42933 req_id = ca946736-b9ab-4207-b59d-71ff8a350d8f response_code = 200 uri = /baseboard
20532024-11-28T04:54:54.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47433
20542024-11-28T04:54:54.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47433 req_id = f42c4ea4-9aec-45e5-8f61-c0fd06632128 response_code = 200 uri = /vpc-routes
20552024-11-28T04:54:54.841ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
20562024-11-28T04:54:54.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47433 req_id = 5e426d21-5455-4c86-8d6f-ec7c1324d8f7 response_code = 204 uri = /eip-gateways
20572024-11-28T04:54:54.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47433 req_id = c547fd27-5fe1-4093-be10-6e5c79c67399 response_code = 204 uri = /vpc-routes
20582024-11-28T04:54:54.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64856
20592024-11-28T04:54:54.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64856 req_id = c59ccc23-ccd1-4fc8-8698-7836325e1821 response_code = 200 uri = /v2p
20602024-11-28T04:54:54.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38958
20612024-11-28T04:54:54.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38958 req_id = 8a56fbf5-6092-4f5a-8510-fc04fbf3c746 response_code = 200 uri = /vpc-routes
20622024-11-28T04:54:54.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39008
20632024-11-28T04:54:54.898ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20642024-11-28T04:54:54.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20652024-11-28T04:54:55.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129525 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39008 req_id = e29d1625-b04d-427b-9601-822f9d61967c response_code = 204 uri = /switch-ports
20662024-11-28T04:54:55.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38375
20672024-11-28T04:54:55.028ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
20682024-11-28T04:54:55.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56589
20692024-11-28T04:54:55.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38958 req_id = 3ad49134-8bbc-4098-9019-6fc04c49cbe9 response_code = 204 uri = /eip-gateways
20702024-11-28T04:54:55.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39008 req_id = d2fd48de-cf31-4c68-9162-f8210e55ad7e response_code = 200 uri = /network-bootstore-config
20712024-11-28T04:54:55.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56589 req_id = 09f1de15-0439-4a6f-b91c-1aa92c895383 response_code = 200 uri = /vpc-routes
20722024-11-28T04:54:55.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38375 req_id = c5abbbfb-b2d2-4510-b7c8-2dc94ad6f9e7 response_code = 200 uri = /v2p
20732024-11-28T04:54:55.047ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
20742024-11-28T04:54:55.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56589 req_id = 68fc0161-ae75-42c5-a52e-7099788f3cc2 response_code = 204 uri = /eip-gateways
20752024-11-28T04:54:55.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43498
20762024-11-28T04:54:55.047ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20772024-11-28T04:54:55.088ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20782024-11-28T04:54:55.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100252 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43498 req_id = a948f156-b979-4d61-90da-673453376134 response_code = 204 uri = /switch-ports
20792024-11-28T04:54:55.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50689
20802024-11-28T04:54:55.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44275
20812024-11-28T04:54:55.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43498 req_id = 0c5688c4-35d6-40a3-8688-959df274002b response_code = 200 uri = /network-bootstore-config
20822024-11-28T04:54:55.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56589 req_id = c9da0bb3-7a95-4d7a-a2c0-b03e26bb8d1c response_code = 204 uri = /vpc-routes
20832024-11-28T04:54:55.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20842024-11-28T04:54:55.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50689 req_id = 6d47960f-5881-4867-bb10-6e0129b99635 response_code = 200 uri = /v2p
20852024-11-28T04:54:55.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38958 req_id = ca116ad9-f0ad-4dda-8c6b-08062fbb9a29 response_code = 204 uri = /vpc-routes
20862024-11-28T04:54:55.185ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20872024-11-28T04:54:55.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44275 req_id = 0d49d3e4-ff16-47de-acee-6bb5a4871b7c response_code = 204 uri = /switch-ports
20882024-11-28T04:54:55.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44275 req_id = 2f2b951e-dafa-4d29-b221-486167ac76dd response_code = 200 uri = /network-bootstore-config
20892024-11-28T04:55:04.046ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20902024-11-28T04:55:06.520ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8184 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 2e4e9e5f-8438-4111-b861-69072b7b6883 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
20912024-11-28T04:55:10.494ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35762
20922024-11-28T04:55:10.495ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35762 req_id = 6d7ff654-da58-4fde-ba7e-6aa704f18a66 response_code = 200 uri = /baseboard
20932024-11-28T04:55:24.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35378
20942024-11-28T04:55:24.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35378 req_id = d34afb91-5f58-497e-8598-9cf4cdd666d6 response_code = 200 uri = /vpc-routes
20952024-11-28T04:55:24.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36467
20962024-11-28T04:55:24.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36467 req_id = 7ff96c2e-c745-4dd8-ab42-d67792ce8089 response_code = 200 uri = /vpc-routes
20972024-11-28T04:55:24.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36362
20982024-11-28T04:55:24.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20992024-11-28T04:55:24.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21002024-11-28T04:55:24.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110780 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36362 req_id = 410f3a65-9e2e-41a6-98fc-21d8aeaba5f7 response_code = 204 uri = /switch-ports
21012024-11-28T04:55:24.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38053
21022024-11-28T04:55:24.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21032024-11-28T04:55:24.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21042024-11-28T04:55:24.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36467 req_id = 57768be9-0c84-4242-b8d8-a8c7e663d83f response_code = 204 uri = /eip-gateways
21052024-11-28T04:55:24.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35378 req_id = 7f1865da-b2ca-4135-8b9c-d201f2647c3b response_code = 204 uri = /eip-gateways
21062024-11-28T04:55:24.832ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21072024-11-28T04:55:24.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36362 req_id = b6811569-ce1d-4ad4-a325-32fb827073a6 response_code = 200 uri = /network-bootstore-config
21082024-11-28T04:55:24.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 430 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35378 req_id = b023d8c0-a168-40eb-b0d6-e02f0ea39181 response_code = 204 uri = /vpc-routes
21092024-11-28T04:55:24.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36467 req_id = 6b6affa6-d5d4-4094-84b3-7348e9beba65 response_code = 204 uri = /vpc-routes
21102024-11-28T04:55:24.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38032
21112024-11-28T04:55:24.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38032 req_id = 0ef10840-fdea-4750-bf0f-754d045517da response_code = 200 uri = /vpc-routes
21122024-11-28T04:55:24.874ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21132024-11-28T04:55:24.887ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21142024-11-28T04:55:24.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38032 req_id = 2c977f91-9dc4-4703-b92d-35ceaf60bdf2 response_code = 204 uri = /eip-gateways
21152024-11-28T04:55:24.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48605
21162024-11-28T04:55:24.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48605 req_id = 4284f0d1-945b-418b-a3ff-ed593ee5bbaf response_code = 200 uri = /v2p
21172024-11-28T04:55:24.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38032 req_id = 11299c2b-0871-4683-bb80-b065143113d4 response_code = 204 uri = /vpc-routes
21182024-11-28T04:55:24.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37407
21192024-11-28T04:55:24.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37407 req_id = 2dbb9777-6f66-4526-806e-345c644e829a response_code = 200 uri = /v2p
21202024-11-28T04:55:24.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103851 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38053 req_id = 04cf8199-3f0c-4b29-8741-0527efd653e2 response_code = 204 uri = /switch-ports
21212024-11-28T04:55:24.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38053 req_id = d9ad35aa-70c2-456e-bee0-560daf57c0e2 response_code = 200 uri = /network-bootstore-config
21222024-11-28T04:55:24.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36967
21232024-11-28T04:55:24.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36967 req_id = 430d0fd7-15b2-4655-a4d7-71997f9eee1e response_code = 200 uri = /v2p
21242024-11-28T04:55:24.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56765
21252024-11-28T04:55:24.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21262024-11-28T04:55:25.024ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21272024-11-28T04:55:25.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94684 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56765 req_id = f99f3d23-7fce-44c5-842b-26e9a701168f response_code = 204 uri = /switch-ports
21282024-11-28T04:55:25.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56765 req_id = 6f28b30f-a56c-4efd-bdbf-49d4ecb4e160 response_code = 200 uri = /network-bootstore-config
21292024-11-28T04:55:36.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6593 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 4c568b0a-d2d8-45ac-a16c-11a15b1993a2 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
21302024-11-28T04:55:40.528ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34979
21312024-11-28T04:55:40.529ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34979 req_id = f430739d-0742-4632-a86b-b7afbc9519bb response_code = 200 uri = /baseboard
21322024-11-28T04:55:54.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65295
21332024-11-28T04:55:54.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65295 req_id = f390968e-edc6-4395-919a-2e8a03eb47f1 response_code = 200 uri = /vpc-routes
21342024-11-28T04:55:54.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21352024-11-28T04:55:54.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65295 req_id = ec58ba26-8c56-4053-8208-08c92ac8c5e0 response_code = 204 uri = /eip-gateways
21362024-11-28T04:55:54.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43061
21372024-11-28T04:55:54.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43061 req_id = ea93f779-270b-4315-ba60-147050bcef12 response_code = 200 uri = /vpc-routes
21382024-11-28T04:55:54.933ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21392024-11-28T04:55:54.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43061 req_id = 8efc582f-9576-4de7-b4db-47aac6655f67 response_code = 204 uri = /eip-gateways
21402024-11-28T04:55:54.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58574
21412024-11-28T04:55:54.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58574 req_id = 05683420-7895-4c70-adda-4e773d9e0654 response_code = 200 uri = /v2p
21422024-11-28T04:55:54.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65295 req_id = 6807050f-1ee0-4efc-a2a9-7b72110efb78 response_code = 204 uri = /vpc-routes
21432024-11-28T04:55:54.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60168
21442024-11-28T04:55:54.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60168 req_id = 6a1fe259-2d55-4346-8270-3832677169ed response_code = 200 uri = /vpc-routes
21452024-11-28T04:55:54.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56482
21462024-11-28T04:55:54.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56482 req_id = 1ccc3220-60e9-478d-ad5a-92f2738c2e6b response_code = 200 uri = /v2p
21472024-11-28T04:55:54.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43061 req_id = e9138c51-f0e3-4238-a5e7-9d097ddb646b response_code = 204 uri = /vpc-routes
21482024-11-28T04:55:55.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48100
21492024-11-28T04:55:55.022ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21502024-11-28T04:55:55.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21512024-11-28T04:55:55.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111051 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48100 req_id = ec2d6c11-f8cc-43f9-8c88-06300590d834 response_code = 204 uri = /switch-ports
21522024-11-28T04:55:55.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63460
21532024-11-28T04:55:55.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34042
21542024-11-28T04:55:55.134ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21552024-11-28T04:55:55.134ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21562024-11-28T04:55:55.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63460 req_id = d97caba0-a693-44ab-aaa3-1b1ccb152532 response_code = 200 uri = /v2p
21572024-11-28T04:55:55.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4099 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48100 req_id = d748f282-354c-4192-8b43-29bfbfdbd00e response_code = 200 uri = /network-bootstore-config
21582024-11-28T04:55:55.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60168 req_id = f732866d-d193-4a2b-8e79-c23f620c3de1 response_code = 204 uri = /eip-gateways
21592024-11-28T04:55:55.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1048 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60168 req_id = 23b094ea-d8d0-4f18-a7c2-decb7e3bba76 response_code = 204 uri = /vpc-routes
21602024-11-28T04:55:55.172ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21612024-11-28T04:55:55.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35848
21622024-11-28T04:55:55.223ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21632024-11-28T04:55:55.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34042 req_id = ac00e536-0077-4fd1-b5f8-23eab0502ac9 response_code = 204 uri = /switch-ports
21642024-11-28T04:55:55.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34042 req_id = ce2489ef-a5c0-4ea6-8b6c-353a3956d3c9 response_code = 200 uri = /network-bootstore-config
21652024-11-28T04:55:55.257ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21662024-11-28T04:55:55.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35848 req_id = f4c6b7c0-db8d-4579-91ce-2c934df11ff4 response_code = 204 uri = /switch-ports
21672024-11-28T04:55:55.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35848 req_id = baa43545-b460-4a49-923a-5d77c75968f5 response_code = 200 uri = /network-bootstore-config
21682024-11-28T04:56:06.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6692 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = fa2852db-6d30-4bcc-b918-81cfad03753e response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
21692024-11-28T04:56:10.564ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43329
21702024-11-28T04:56:10.564ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43329 req_id = 4c58c659-dac0-4cbc-a1cc-2a9d43e98e4d response_code = 200 uri = /baseboard
21712024-11-28T04:56:24.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37025
21722024-11-28T04:56:24.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37025 req_id = 45dc5608-a8f4-463b-835a-05b7ee4dfed5 response_code = 200 uri = /vpc-routes
21732024-11-28T04:56:24.630ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21742024-11-28T04:56:24.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37025 req_id = 7f1744a9-1a50-47ed-9fa9-1d50c294ffc4 response_code = 204 uri = /eip-gateways
21752024-11-28T04:56:24.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44344
21762024-11-28T04:56:24.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44344 req_id = 7d8aa4a7-1280-4550-9e32-7ae62454036f response_code = 200 uri = /vpc-routes
21772024-11-28T04:56:24.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60328
21782024-11-28T04:56:24.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60328 req_id = c892d85f-97ff-47d8-b3e6-c31e9c0e068f response_code = 200 uri = /v2p
21792024-11-28T04:56:24.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21802024-11-28T04:56:24.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44344 req_id = e89929fc-eb44-4a5d-99f8-2c6a5a3b9391 response_code = 204 uri = /eip-gateways
21812024-11-28T04:56:24.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57338
21822024-11-28T04:56:24.759ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21832024-11-28T04:56:24.801ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21842024-11-28T04:56:24.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57338 req_id = 8e37476e-5322-44aa-8d02-1a1b9277a08e response_code = 204 uri = /switch-ports
21852024-11-28T04:56:24.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45892
21862024-11-28T04:56:24.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52464
21872024-11-28T04:56:24.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45517
21882024-11-28T04:56:24.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 457 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44344 req_id = 4180ab67-2be4-44d3-94e7-535ca737d965 response_code = 204 uri = /vpc-routes
21892024-11-28T04:56:24.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57338 req_id = 5e984087-d818-4301-b8f2-245d07739b80 response_code = 200 uri = /network-bootstore-config
21902024-11-28T04:56:24.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 537 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37025 req_id = fdb7305a-4946-43b6-a3d4-9c7e1af146dc response_code = 204 uri = /vpc-routes
21912024-11-28T04:56:24.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21922024-11-28T04:56:24.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52464 req_id = d2ef4904-8a34-40bc-8892-d8a6aef164c3 response_code = 200 uri = /vpc-routes
21932024-11-28T04:56:24.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 399 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45892 req_id = 609fb721-31cc-4455-8ad8-9759c682216e response_code = 200 uri = /v2p
21942024-11-28T04:56:24.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63906
21952024-11-28T04:56:24.901ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21962024-11-28T04:56:24.911ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
21972024-11-28T04:56:24.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52464 req_id = 6ef230a7-c138-487e-b0dc-8a739ee59e64 response_code = 204 uri = /eip-gateways
21982024-11-28T04:56:24.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58972
21992024-11-28T04:56:24.956ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22002024-11-28T04:56:24.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93950 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45517 req_id = 745c78f6-65bf-4f77-be43-c096988d6830 response_code = 204 uri = /switch-ports
22012024-11-28T04:56:24.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 455 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45517 req_id = 458d74a2-ea66-42e4-b656-b5208f1be6e1 response_code = 200 uri = /network-bootstore-config
22022024-11-28T04:56:24.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4007 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58972 req_id = 2ed9e25d-dc7c-4544-bafe-a280722469d1 response_code = 200 uri = /v2p
22032024-11-28T04:56:24.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22042024-11-28T04:56:25.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52464 req_id = e71920f0-6eae-4812-9111-6aa50032d3b3 response_code = 204 uri = /vpc-routes
22052024-11-28T04:56:25.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167734 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63906 req_id = 9464ba70-e366-4daf-8699-a37635871e07 response_code = 204 uri = /switch-ports
22062024-11-28T04:56:25.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63906 req_id = b8341441-0b53-4764-b860-52c9032d0b70 response_code = 200 uri = /network-bootstore-config
22072024-11-28T04:56:36.520ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7471 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 7421aef9-4c1e-4465-b036-9b8a737f2357 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
22082024-11-28T04:56:40.597ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41781
22092024-11-28T04:56:40.597ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41781 req_id = 4f29a270-92b7-439d-bd09-fc2c809fbc11 response_code = 200 uri = /baseboard
22102024-11-28T04:56:54.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64268
22112024-11-28T04:56:54.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64268 req_id = de14fd7b-1a5c-4113-b0f0-be7fd29cfe12 response_code = 200 uri = /vpc-routes
22122024-11-28T04:56:54.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42353
22132024-11-28T04:56:54.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42353 req_id = 4de0539d-658b-440b-8243-f5cffe01c5c6 response_code = 200 uri = /vpc-routes
22142024-11-28T04:56:54.865ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
22152024-11-28T04:56:54.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64268 req_id = b4245880-1495-4471-988b-4ff7d2a960c5 response_code = 204 uri = /eip-gateways
22162024-11-28T04:56:54.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59413
22172024-11-28T04:56:54.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59413 req_id = 3bf6ee56-56ed-466e-b5a2-f62568f32ed1 response_code = 200 uri = /v2p
22182024-11-28T04:56:54.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64268 req_id = 12637d2a-122c-451c-902f-8deaab005bf8 response_code = 204 uri = /vpc-routes
22192024-11-28T04:56:54.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
22202024-11-28T04:56:54.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42353 req_id = a64ee6c1-c5cc-41c6-ba30-a806f2c19210 response_code = 204 uri = /eip-gateways
22212024-11-28T04:56:54.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42353 req_id = abb37186-89ab-4c7a-a97e-5184125e6850 response_code = 204 uri = /vpc-routes
22222024-11-28T04:56:54.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60798
22232024-11-28T04:56:54.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60798 req_id = 7670df19-a3cf-44b2-b44c-db935b0fabdd response_code = 200 uri = /v2p
22242024-11-28T04:56:54.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52305
22252024-11-28T04:56:54.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52305 req_id = 379beb96-5df2-40bc-92fe-523f7bf8b04a response_code = 200 uri = /vpc-routes
22262024-11-28T04:56:55.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54151
22272024-11-28T04:56:55.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22282024-11-28T04:56:55.061ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22292024-11-28T04:56:55.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54151 req_id = 1609f9df-da2a-4bf5-a6e3-46dcc9b267ed response_code = 204 uri = /switch-ports
22302024-11-28T04:56:55.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61493
22312024-11-28T04:56:55.123ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
22322024-11-28T04:56:55.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52305 req_id = 51587eac-ca42-4e25-9074-7315f6bb4d3c response_code = 204 uri = /eip-gateways
22332024-11-28T04:56:55.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54151 req_id = 15fe809a-db34-4365-9583-92404cc1c47a response_code = 200 uri = /network-bootstore-config
22342024-11-28T04:56:55.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22352024-11-28T04:56:55.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52305 req_id = 60891717-cc5c-4729-92ad-b55723497fb1 response_code = 204 uri = /vpc-routes
22362024-11-28T04:56:55.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22372024-11-28T04:56:55.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61493 req_id = cc4aadf1-36d4-4d54-9d96-4c05391ab9a6 response_code = 204 uri = /switch-ports
22382024-11-28T04:56:55.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61493 req_id = 9c81c605-98f5-4fc2-b084-bfe162722256 response_code = 200 uri = /network-bootstore-config
22392024-11-28T04:56:55.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37778
22402024-11-28T04:56:55.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37778 req_id = 76462576-6b51-44c9-8fb2-6e9facfacc71 response_code = 200 uri = /v2p
22412024-11-28T04:56:55.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33175
22422024-11-28T04:56:55.269ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22432024-11-28T04:56:55.305ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22442024-11-28T04:56:55.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90564 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33175 req_id = 41827f1f-1ea2-4149-9703-4c6ba988b13f response_code = 204 uri = /switch-ports
22452024-11-28T04:56:55.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33175 req_id = c1eeb840-d384-4a2f-9ddb-d0b1b13ba1ec response_code = 200 uri = /network-bootstore-config
22462024-11-28T04:57:06.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6509 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = bd35d831-663e-4e25-b600-8c4b6038afcf response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
22472024-11-28T04:57:10.631ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46239
22482024-11-28T04:57:10.631ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46239 req_id = bce5be14-1571-4f71-b9af-915b13e37cb9 response_code = 200 uri = /baseboard
22492024-11-28T04:57:24.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47116
22502024-11-28T04:57:24.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47116 req_id = 3259f609-bc3d-4409-8255-26b785f23b3f response_code = 200 uri = /vpc-routes
22512024-11-28T04:57:24.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50472
22522024-11-28T04:57:24.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50472 req_id = 610c1954-7687-4c63-81a9-dca5564cc646 response_code = 200 uri = /v2p
22532024-11-28T04:57:24.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38319
22542024-11-28T04:57:24.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38319 req_id = b17fc623-e635-4d39-a8e1-73cea9d6fd11 response_code = 200 uri = /vpc-routes
22552024-11-28T04:57:24.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
22562024-11-28T04:57:24.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47116 req_id = c24a1f51-e65c-4409-bb03-0ac0ca82a163 response_code = 204 uri = /eip-gateways
22572024-11-28T04:57:24.776ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
22582024-11-28T04:57:24.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38319 req_id = 17a9ca8a-9701-4dc7-a01e-c78ab711af33 response_code = 204 uri = /eip-gateways
22592024-11-28T04:57:24.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47116 req_id = a186f41a-d3ae-45c1-8939-b3ad0d1648f3 response_code = 204 uri = /vpc-routes
22602024-11-28T04:57:24.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38319 req_id = 4df3c07d-3fd4-44ff-b52f-bb712286e1da response_code = 204 uri = /vpc-routes
22612024-11-28T04:57:24.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47820
22622024-11-28T04:57:24.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47820 req_id = 0dbd0afe-8eab-4a92-be4d-ad0e49d2e23a response_code = 200 uri = /vpc-routes
22632024-11-28T04:57:24.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41502
22642024-11-28T04:57:24.829ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22652024-11-28T04:57:24.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22662024-11-28T04:57:24.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41502 req_id = bd05be48-b288-4542-9ca6-532fece49b6c response_code = 204 uri = /switch-ports
22672024-11-28T04:57:24.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46620
22682024-11-28T04:57:24.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38486
22692024-11-28T04:57:24.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59325
22702024-11-28T04:57:24.938ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
22712024-11-28T04:57:24.938ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22722024-11-28T04:57:24.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47820 req_id = 1aa12c85-e0c3-4175-bcd1-4bc10261b8fa response_code = 204 uri = /eip-gateways
22732024-11-28T04:57:24.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41502 req_id = df1a52cc-dab5-4090-808c-ca05463ba67e response_code = 200 uri = /network-bootstore-config
22742024-11-28T04:57:24.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59325 req_id = a8c79006-0353-423d-9a88-f157d93d5a00 response_code = 200 uri = /v2p
22752024-11-28T04:57:24.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22762024-11-28T04:57:25.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63177
22772024-11-28T04:57:25.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63177 req_id = 0d4e053b-3465-416a-b267-03b8fb148746 response_code = 200 uri = /v2p
22782024-11-28T04:57:25.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46620 req_id = ab305813-a9ce-47e9-9a1e-0da185bbfe42 response_code = 204 uri = /switch-ports
22792024-11-28T04:57:25.030ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22802024-11-28T04:57:25.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 704 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46620 req_id = 64c7f281-2065-463e-a9db-1341db98b548 response_code = 200 uri = /network-bootstore-config
22812024-11-28T04:57:25.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 987 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47820 req_id = 954a1fa0-c2ff-41e6-b2dd-64337772e532 response_code = 204 uri = /vpc-routes
22822024-11-28T04:57:25.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22832024-11-28T04:57:25.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38486 req_id = 01f39115-f535-496f-a87b-cbf015e2e584 response_code = 204 uri = /switch-ports
22842024-11-28T04:57:25.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38486 req_id = e03950b2-c7c4-4b5c-868f-2a56b68b9357 response_code = 200 uri = /network-bootstore-config
22852024-11-28T04:57:36.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6269 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = eccb9709-b3c5-4c9f-93a7-16de8a55d936 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
22862024-11-28T04:57:40.663ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52835
22872024-11-28T04:57:40.663ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52835 req_id = 7bd53563-93a9-43fa-b4e7-e69524064f5d response_code = 200 uri = /baseboard
22882024-11-28T04:57:54.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34657
22892024-11-28T04:57:54.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34657 req_id = 7b4ad6dc-fa52-4df7-98b2-dda03d1f62e9 response_code = 200 uri = /v2p
22902024-11-28T04:57:54.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58227
22912024-11-28T04:57:54.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58227 req_id = 97642d93-78bc-4a15-a0d6-3f7adafa1705 response_code = 200 uri = /vpc-routes
22922024-11-28T04:57:54.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56336
22932024-11-28T04:57:54.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56336 req_id = 49aaaa54-0764-462f-bf87-857b22f49f32 response_code = 200 uri = /vpc-routes
22942024-11-28T04:57:54.945ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
22952024-11-28T04:57:54.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58227 req_id = b304fd3d-3b08-43f5-b1fe-0a42f6484a00 response_code = 204 uri = /eip-gateways
22962024-11-28T04:57:54.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58227 req_id = b6cb248c-5c39-4ee5-89f9-ef9776ed1a9a response_code = 204 uri = /vpc-routes
22972024-11-28T04:57:54.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
22982024-11-28T04:57:54.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56336 req_id = 7c7d3d07-0ba3-436d-83eb-4a99730e1401 response_code = 204 uri = /eip-gateways
22992024-11-28T04:57:54.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59573
23002024-11-28T04:57:54.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59573 req_id = 9ac61551-8eee-4119-a9d8-d7af32190826 response_code = 200 uri = /vpc-routes
23012024-11-28T04:57:54.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56336 req_id = b4ee9f7d-5d17-4d80-986f-bd1e92607d48 response_code = 204 uri = /vpc-routes
23022024-11-28T04:57:55.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
23032024-11-28T04:57:55.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59573 req_id = 4321662b-a8b2-4514-a053-7b8183a3b466 response_code = 204 uri = /eip-gateways
23042024-11-28T04:57:55.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51026
23052024-11-28T04:57:55.010ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23062024-11-28T04:57:55.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23072024-11-28T04:57:55.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123668 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51026 req_id = 2d2d59c2-21ab-4c2d-9a8b-d2b40ced70e9 response_code = 204 uri = /switch-ports
23082024-11-28T04:57:55.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53382
23092024-11-28T04:57:55.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45202
23102024-11-28T04:57:55.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36203
23112024-11-28T04:57:55.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51026 req_id = ec38560a-4611-4591-9669-d96759742c4a response_code = 200 uri = /network-bootstore-config
23122024-11-28T04:57:55.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59573 req_id = 177cd092-9283-46fb-ba76-75bd9e16ab19 response_code = 204 uri = /vpc-routes
23132024-11-28T04:57:55.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36203 req_id = dea07a37-59b4-4a74-938c-97583e9fd474 response_code = 200 uri = /v2p
23142024-11-28T04:57:55.134ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23152024-11-28T04:57:55.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53382 req_id = 7bbd1adc-9368-4138-9db3-3efe96baca7e response_code = 200 uri = /v2p
23162024-11-28T04:57:55.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40590
23172024-11-28T04:57:55.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23182024-11-28T04:57:55.228ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23192024-11-28T04:57:55.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45202 req_id = b06f0d54-b5a1-49aa-be3b-8469477b763a response_code = 204 uri = /switch-ports
23202024-11-28T04:57:55.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45202 req_id = aa56b10c-7d7d-4fde-af64-9346a907b577 response_code = 200 uri = /network-bootstore-config
23212024-11-28T04:57:55.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23222024-11-28T04:57:55.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40590 req_id = 6c5072f1-8f90-4aef-9f0d-2a4db0a6915e response_code = 204 uri = /switch-ports
23232024-11-28T04:57:55.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40590 req_id = c0c71b05-36f3-4ca1-9f5d-8860a7331300 response_code = 200 uri = /network-bootstore-config
23242024-11-28T04:58:06.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6019 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 0d5c777a-d6b2-47bd-bd06-2276afc90f29 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
23252024-11-28T04:58:10.697ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50445
23262024-11-28T04:58:10.697ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50445 req_id = dd6f2987-dac7-4512-ba19-27043a44bd22 response_code = 200 uri = /baseboard
23272024-11-28T04:58:24.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39659
23282024-11-28T04:58:24.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39659 req_id = 7963bf81-2907-4655-b9fd-b9f9e4f59cd3 response_code = 200 uri = /vpc-routes
23292024-11-28T04:58:24.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58131
23302024-11-28T04:58:24.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58131 req_id = e5c6b407-4699-467e-89b3-41cc0b33ca6a response_code = 200 uri = /vpc-routes
23312024-11-28T04:58:24.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
23322024-11-28T04:58:24.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58131 req_id = 404ccee7-ec8e-488b-90df-bf95d84deeb9 response_code = 204 uri = /eip-gateways
23332024-11-28T04:58:24.712ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
23342024-11-28T04:58:24.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39659 req_id = 2123c137-9f76-440b-8ff8-5290c9578d6e response_code = 204 uri = /eip-gateways
23352024-11-28T04:58:24.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33140
23362024-11-28T04:58:24.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23372024-11-28T04:58:24.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23382024-11-28T04:58:24.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33140 req_id = 1d66e4ee-7748-49e9-9ab7-3767f5011ae6 response_code = 204 uri = /switch-ports
23392024-11-28T04:58:24.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43300
23402024-11-28T04:58:24.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58131 req_id = c9896d54-cf49-441b-bbac-7a6b2a5ef3ab response_code = 204 uri = /vpc-routes
23412024-11-28T04:58:24.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43300 req_id = 48d955c2-d4b8-444e-ba7d-6e9f1955e936 response_code = 200 uri = /v2p
23422024-11-28T04:58:24.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33140 req_id = 61570412-9a44-42e9-9bfc-67237de0cba7 response_code = 200 uri = /network-bootstore-config
23432024-11-28T04:58:24.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39659 req_id = 6924fe29-93db-4e26-b43a-6711dce1d13e response_code = 204 uri = /vpc-routes
23442024-11-28T04:58:24.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37732
23452024-11-28T04:58:24.834ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23462024-11-28T04:58:24.868ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23472024-11-28T04:58:24.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37732 req_id = 9f006612-91b3-412b-b988-5e186a492776 response_code = 204 uri = /switch-ports
23482024-11-28T04:58:24.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38065
23492024-11-28T04:58:24.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37732 req_id = c53fec5a-4630-4754-9cc7-297eb5e1d26f response_code = 200 uri = /network-bootstore-config
23502024-11-28T04:58:24.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38065 req_id = ee8ee4ee-a288-46ac-82da-a2d75f3ef01d response_code = 200 uri = /v2p
23512024-11-28T04:58:25.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59276
23522024-11-28T04:58:25.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59276 req_id = 9f31e67b-239a-46b0-82a8-e36302bc5a86 response_code = 200 uri = /v2p
23532024-11-28T04:58:25.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39223
23542024-11-28T04:58:25.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39223 req_id = 754d5345-900e-4d71-8566-5585e541ab13 response_code = 200 uri = /vpc-routes
23552024-11-28T04:58:25.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49889
23562024-11-28T04:58:25.091ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23572024-11-28T04:58:25.122ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23582024-11-28T04:58:25.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77698 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49889 req_id = d5aa20bf-a108-4f63-a8db-a025f9cacbac response_code = 204 uri = /switch-ports
23592024-11-28T04:58:25.169ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
23602024-11-28T04:58:25.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39223 req_id = 4cee4453-acbe-4da1-9344-2bee550eb3ec response_code = 204 uri = /eip-gateways
23612024-11-28T04:58:25.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49889 req_id = f8fcb635-64f3-4dec-8418-7fc9d0f58f77 response_code = 200 uri = /network-bootstore-config
23622024-11-28T04:58:25.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39223 req_id = 58d3beab-771a-430a-8bf1-f2337d89a940 response_code = 204 uri = /vpc-routes
23632024-11-28T04:58:36.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6306 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 8ab0170a-927f-4511-a8b5-7639b3ce6cbe response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
23642024-11-28T04:58:40.731ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37607
23652024-11-28T04:58:40.731ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37607 req_id = 2ad9699f-1a64-4400-a9f9-9c696fb333ba response_code = 200 uri = /baseboard
23662024-11-28T04:58:54.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36158
23672024-11-28T04:58:54.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36158 req_id = 4fa4f89d-33e1-4f46-8202-23cef0f3efc9 response_code = 200 uri = /v2p
23682024-11-28T04:58:54.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64923
23692024-11-28T04:58:54.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64923 req_id = 0c9777d2-f9f6-478d-936a-a06f7ccd7706 response_code = 200 uri = /vpc-routes
23702024-11-28T04:58:54.846ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
23712024-11-28T04:58:54.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64923 req_id = 9fd24278-7c56-4a19-9bf3-d86db349c821 response_code = 204 uri = /eip-gateways
23722024-11-28T04:58:54.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64923 req_id = d1960e65-4bbe-40fb-a29b-10cc399e5347 response_code = 204 uri = /vpc-routes
23732024-11-28T04:58:54.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40820
23742024-11-28T04:58:54.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40820 req_id = 56e4b806-6fe3-4563-8f17-8f418a49e9da response_code = 200 uri = /vpc-routes
23752024-11-28T04:58:54.892ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
23762024-11-28T04:58:54.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40820 req_id = 3649ebd6-87a5-4f99-bc98-a19eef9c2a7d response_code = 204 uri = /eip-gateways
23772024-11-28T04:58:54.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40820 req_id = 1ee87af4-452f-4bac-96bd-8cb581817d0f response_code = 204 uri = /vpc-routes
23782024-11-28T04:58:54.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47969
23792024-11-28T04:58:54.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47969 req_id = 96c64a99-c905-4e93-bad3-4261bdf3d0f7 response_code = 200 uri = /vpc-routes
23802024-11-28T04:58:54.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48288
23812024-11-28T04:58:54.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48288 req_id = d396a700-a452-4a41-b7e7-19d28a6ec16b response_code = 200 uri = /v2p
23822024-11-28T04:58:54.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39247
23832024-11-28T04:58:54.970ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23842024-11-28T04:58:55.012ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23852024-11-28T04:58:55.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100805 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39247 req_id = 587a0f74-88a4-422c-b6c0-63784d29ea8a response_code = 204 uri = /switch-ports
23862024-11-28T04:58:55.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64699
23872024-11-28T04:58:55.071ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
23882024-11-28T04:58:55.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47969 req_id = 4022987c-02d1-4852-a686-080283795ee3 response_code = 204 uri = /eip-gateways
23892024-11-28T04:58:55.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49445
23902024-11-28T04:58:55.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48452
23912024-11-28T04:58:55.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46838
23922024-11-28T04:58:55.071ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23932024-11-28T04:58:55.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39247 req_id = 3fea5ca9-348f-4977-a9a9-bec842fd6ac1 response_code = 200 uri = /network-bootstore-config
23942024-11-28T04:58:55.075ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23952024-11-28T04:58:55.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48452 req_id = ce54fe4b-40f9-48d3-aa3f-eed21fc78bc3 response_code = 200 uri = /v2p
23962024-11-28T04:58:55.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23972024-11-28T04:58:55.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23982024-11-28T04:58:55.076ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23992024-11-28T04:58:55.076ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24002024-11-28T04:58:55.076ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24012024-11-28T04:58:55.076ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24022024-11-28T04:58:55.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1429 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49445 req_id = bd8b3996-8459-44d5-897b-277c037470bc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24032024-11-28T04:58:55.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 794 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47969 req_id = 9bb890d9-e51e-4dd5-b1fb-cf54007fa312 response_code = 204 uri = /vpc-routes
24042024-11-28T04:58:55.112ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24052024-11-28T04:58:55.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24062024-11-28T04:58:55.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64699 req_id = 3c77f240-3f1e-4b0a-beb0-6ee33bbfbcb1 response_code = 204 uri = /switch-ports
24072024-11-28T04:58:55.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 688 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64699 req_id = cd929cb5-81d5-4f72-bcb7-f9659730232a response_code = 200 uri = /network-bootstore-config
24082024-11-28T04:58:55.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57019
24092024-11-28T04:58:55.196ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24102024-11-28T04:58:55.196ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24112024-11-28T04:58:55.196ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24122024-11-28T04:58:55.196ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24132024-11-28T04:58:55.196ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24142024-11-28T04:58:55.196ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24152024-11-28T04:58:55.196ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24162024-11-28T04:58:55.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57019 req_id = ddcf9451-932b-4b29-bbd6-17a58ae44e3d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24172024-11-28T04:58:55.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24182024-11-28T04:58:55.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48971
24192024-11-28T04:58:55.240ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24202024-11-28T04:58:55.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24212024-11-28T04:58:55.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24222024-11-28T04:58:55.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24232024-11-28T04:58:55.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24242024-11-28T04:58:55.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24252024-11-28T04:58:55.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24262024-11-28T04:58:55.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 694 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48971 req_id = b904e67e-b343-4339-a6af-7d9f292d6d44 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24272024-11-28T04:58:55.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46838 req_id = 5524b8fa-c22a-4273-9ac6-0aa07ff97950 response_code = 204 uri = /switch-ports
24282024-11-28T04:58:55.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46838 req_id = f9c76463-821b-4077-b034-f58321f5e453 response_code = 200 uri = /network-bootstore-config
24292024-11-28T04:59:06.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6457 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = b9a14bbd-99c6-49de-8ae9-80a59fd49194 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
24302024-11-28T04:59:10.764ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58481
24312024-11-28T04:59:10.764ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58481 req_id = 5acfc70b-5aad-43a6-93fc-c92d6fb3764a response_code = 200 uri = /baseboard
24322024-11-28T04:59:24.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44189
24332024-11-28T04:59:24.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44189 req_id = f6915490-b0f4-4e84-8889-11ab4b944ee0 response_code = 200 uri = /vpc-routes
24342024-11-28T04:59:24.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
24352024-11-28T04:59:24.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44189 req_id = 5778b6a4-7a7d-42ef-9e49-16e3303dea44 response_code = 204 uri = /eip-gateways
24362024-11-28T04:59:24.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44189 req_id = a2c3183b-e379-4c9d-a619-280e3898d33a response_code = 204 uri = /vpc-routes
24372024-11-28T04:59:24.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64998
24382024-11-28T04:59:24.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64998 req_id = 2ec23975-6cd5-4c3e-97ce-04ad31118cb1 response_code = 200 uri = /vpc-routes
24392024-11-28T04:59:24.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
24402024-11-28T04:59:24.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64998 req_id = 6ed6e3bd-5142-4e37-8520-a292c8796664 response_code = 204 uri = /eip-gateways
24412024-11-28T04:59:24.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34580
24422024-11-28T04:59:24.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24432024-11-28T04:59:24.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24442024-11-28T04:59:24.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34580 req_id = a88eb377-5b1f-4740-88c4-d466c09988e3 response_code = 204 uri = /switch-ports
24452024-11-28T04:59:24.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35733
24462024-11-28T04:59:24.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64998 req_id = 82e8e605-1b89-4c26-9ea8-c559a4900013 response_code = 204 uri = /vpc-routes
24472024-11-28T04:59:24.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34580 req_id = ad31e527-e92f-4bf7-9753-88061efe61a6 response_code = 200 uri = /network-bootstore-config
24482024-11-28T04:59:24.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35733 req_id = 3f315bbe-8013-44c2-ba2b-5a835cf7f9ba response_code = 200 uri = /v2p
24492024-11-28T04:59:24.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60132
24502024-11-28T04:59:24.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60132 req_id = 1262c78f-910e-4468-aae1-2e4e2cd30dd3 response_code = 200 uri = /v2p
24512024-11-28T04:59:24.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42122
24522024-11-28T04:59:24.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24532024-11-28T04:59:24.969ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24542024-11-28T04:59:25.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90114 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42122 req_id = ae09026e-342e-4391-954d-5a59faa97cbb response_code = 204 uri = /switch-ports
24552024-11-28T04:59:25.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53452
24562024-11-28T04:59:25.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61472
24572024-11-28T04:59:25.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55660
24582024-11-28T04:59:25.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42122 req_id = 8b07ae72-401c-440d-bd64-941677b872b9 response_code = 200 uri = /network-bootstore-config
24592024-11-28T04:59:25.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53452 req_id = 83ef3b03-b74f-47b9-8d45-d464b8ac85bc response_code = 200 uri = /vpc-routes
24602024-11-28T04:59:25.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61472 req_id = d06096c1-6b5b-4fad-a28e-abe39ca63b65 response_code = 200 uri = /v2p
24612024-11-28T04:59:25.026ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24622024-11-28T04:59:25.062ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24632024-11-28T04:59:25.075ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
24642024-11-28T04:59:25.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3054 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53452 req_id = 75508461-2bc4-46f5-ae5f-80ad69a18050 response_code = 204 uri = /eip-gateways
24652024-11-28T04:59:25.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53452 req_id = ca99095c-54d0-406d-9461-c0ce588c289a response_code = 204 uri = /vpc-routes
24662024-11-28T04:59:25.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82893 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55660 req_id = b679bcb8-2d2e-4aff-82da-7262a2d8530d response_code = 204 uri = /switch-ports
24672024-11-28T04:59:25.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55660 req_id = e3be1b95-3ad3-4e40-96e2-7ed829c211d1 response_code = 200 uri = /network-bootstore-config
24682024-11-28T04:59:36.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5998 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 6f829464-5b7b-42dd-a23b-6b70980b5b46 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
24692024-11-28T04:59:40.796ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58268
24702024-11-28T04:59:40.796ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58268 req_id = b95a15e0-3442-4ea1-8036-686845e6a71a response_code = 200 uri = /baseboard
24712024-11-28T04:59:49.541ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24722024-11-28T04:59:49.541ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24732024-11-28T04:59:49.572ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 8885, tv_nsec: 426119394 } time_to_next_cleanup = 599.99999398s
24742024-11-28T04:59:54.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36492
24752024-11-28T04:59:54.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36492 req_id = d470521d-1e41-4bd5-a3a6-835df7c7ac20 response_code = 200 uri = /vpc-routes
24762024-11-28T04:59:54.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49334
24772024-11-28T04:59:54.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49334 req_id = 90871843-ef23-436c-b72d-bffdc9502a62 response_code = 200 uri = /vpc-routes
24782024-11-28T04:59:54.853ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
24792024-11-28T04:59:54.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36492 req_id = 741ddf72-fbcc-44e9-9140-c0485fbfa3bf response_code = 204 uri = /eip-gateways
24802024-11-28T04:59:54.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45647
24812024-11-28T04:59:54.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45647 req_id = 2a0501df-c6ed-431d-a326-527e46211ca4 response_code = 200 uri = /v2p
24822024-11-28T04:59:54.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36492 req_id = 4008e717-7c1d-4836-b094-9e1872b1b4a9 response_code = 204 uri = /vpc-routes
24832024-11-28T04:59:54.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
24842024-11-28T04:59:54.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49334 req_id = 0be4b076-1785-4ef7-b527-7bde0cc43d68 response_code = 204 uri = /eip-gateways
24852024-11-28T04:59:54.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49334 req_id = 4ee35f55-710b-450f-8d6d-4300d754031d response_code = 204 uri = /vpc-routes
24862024-11-28T04:59:55.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47822
24872024-11-28T04:59:55.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47822 req_id = 9c7c3f37-e084-4e7a-a863-38758b9ec540 response_code = 200 uri = /vpc-routes
24882024-11-28T04:59:55.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53946
24892024-11-28T04:59:55.026ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24902024-11-28T04:59:55.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24912024-11-28T04:59:55.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94070 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53946 req_id = 984860b9-5def-4a19-b7fa-50fed0b84c90 response_code = 204 uri = /switch-ports
24922024-11-28T04:59:55.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42377
24932024-11-28T04:59:55.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58065
24942024-11-28T04:59:55.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42377 req_id = c766aa6a-b857-4152-8244-1dc930f3454a response_code = 200 uri = /v2p
24952024-11-28T04:59:55.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53946 req_id = f90c31ae-87a5-4620-9bd2-083f3f48a99a response_code = 200 uri = /network-bootstore-config
24962024-11-28T04:59:55.121ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
24972024-11-28T04:59:55.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58065 req_id = 34a0247f-a99f-4f33-88de-e681e74159c9 response_code = 200 uri = /v2p
24982024-11-28T04:59:55.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47822 req_id = ffa6ee07-6a67-46d6-9fb1-da8dc8fac9dc response_code = 204 uri = /eip-gateways
24992024-11-28T04:59:55.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47822 req_id = 747dd0cb-4b16-47df-84f2-7e85b324b1be response_code = 204 uri = /vpc-routes
25002024-11-28T04:59:55.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32980
25012024-11-28T04:59:55.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25022024-11-28T04:59:55.191ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25032024-11-28T04:59:55.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91786 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32980 req_id = 3ef7e08b-615f-45a6-8039-3798aeb605de response_code = 204 uri = /switch-ports
25042024-11-28T04:59:55.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60170
25052024-11-28T04:59:55.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25062024-11-28T04:59:55.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3691 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32980 req_id = 890d0027-09ac-4ab0-9478-924a00bb5f5d response_code = 200 uri = /network-bootstore-config
25072024-11-28T04:59:55.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25082024-11-28T04:59:55.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60170 req_id = 91197944-7a2a-4a79-adac-0a13a0522c7b response_code = 204 uri = /switch-ports
25092024-11-28T04:59:55.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60170 req_id = 38ae3e6a-2190-426b-bee2-2689c8f294d9 response_code = 200 uri = /network-bootstore-config
25102024-11-28T05:00:04.047ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25112024-11-28T05:00:06.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6738 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 2436c09e-2f04-47f6-bd4d-e4ffff7d5583 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
25122024-11-28T05:00:10.829ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52596
25132024-11-28T05:00:10.829ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52596 req_id = cff79836-9866-430b-b372-ddc1b46a4125 response_code = 200 uri = /baseboard
25142024-11-28T05:00:24.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64177
25152024-11-28T05:00:24.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64177 req_id = efa6b98d-4659-4f3a-9243-a9454b290d19 response_code = 200 uri = /vpc-routes
25162024-11-28T05:00:24.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
25172024-11-28T05:00:24.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64177 req_id = 5ad301e4-0c1c-48af-a20e-f6c8ff490b71 response_code = 204 uri = /eip-gateways
25182024-11-28T05:00:24.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56547
25192024-11-28T05:00:24.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56547 req_id = 3ed70316-ece8-4175-ac05-dbdffaab72cf response_code = 200 uri = /v2p
25202024-11-28T05:00:24.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64177 req_id = e75143c5-f4c3-4faa-9f4b-6455fc4eaf4c response_code = 204 uri = /vpc-routes
25212024-11-28T05:00:24.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54891
25222024-11-28T05:00:24.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54891 req_id = 85869271-b14f-447e-9d3a-8b5bbd3f24ec response_code = 200 uri = /vpc-routes
25232024-11-28T05:00:24.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59096
25242024-11-28T05:00:24.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59096 req_id = a62b5653-e1f5-4099-a3b5-9bf645071490 response_code = 200 uri = /v2p
25252024-11-28T05:00:24.736ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
25262024-11-28T05:00:24.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54891 req_id = 73246c82-604f-46c1-951c-0a8a11ae42a8 response_code = 204 uri = /eip-gateways
25272024-11-28T05:00:24.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54891 req_id = de7db0e9-4aa5-4803-bf4d-695d2b155ec8 response_code = 204 uri = /vpc-routes
25282024-11-28T05:00:24.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32960
25292024-11-28T05:00:24.755ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25302024-11-28T05:00:24.802ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25312024-11-28T05:00:24.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116449 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32960 req_id = 7154ccc8-aacc-477c-95d3-142bf6da450d response_code = 204 uri = /switch-ports
25322024-11-28T05:00:24.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42824
25332024-11-28T05:00:24.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47665
25342024-11-28T05:00:24.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32960 req_id = 71871430-0535-464b-a448-2fe9a69b6446 response_code = 200 uri = /network-bootstore-config
25352024-11-28T05:00:24.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42824 req_id = d1e1b56d-ed39-401e-a244-35aedc8816cc response_code = 200 uri = /vpc-routes
25362024-11-28T05:00:24.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25372024-11-28T05:00:24.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
25382024-11-28T05:00:24.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 585 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42824 req_id = a3019232-6dcd-4498-8541-c3da2cc2178f response_code = 204 uri = /eip-gateways
25392024-11-28T05:00:24.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1089 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42824 req_id = 4da07306-6c02-420e-a153-8fca5ce03dc8 response_code = 204 uri = /vpc-routes
25402024-11-28T05:00:24.915ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25412024-11-28T05:00:24.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57722
25422024-11-28T05:00:24.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57722 req_id = 754d8677-185f-4e66-893f-ab0e33f526f7 response_code = 200 uri = /v2p
25432024-11-28T05:00:24.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47665 req_id = 03b01daa-9972-4be0-99de-1ccdeff7a488 response_code = 204 uri = /switch-ports
25442024-11-28T05:00:24.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47665 req_id = 2666b3a4-067e-4095-b230-b9375765baf6 response_code = 200 uri = /network-bootstore-config
25452024-11-28T05:00:25.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40682
25462024-11-28T05:00:25.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25472024-11-28T05:00:25.075ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25482024-11-28T05:00:25.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40682 req_id = e4579147-8886-4edd-a3d2-5ad08e8bffbb response_code = 204 uri = /switch-ports
25492024-11-28T05:00:25.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40682 req_id = d499876f-fd25-414a-baa3-9e53d20e0daf response_code = 200 uri = /network-bootstore-config
25502024-11-28T05:00:36.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6930 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 68274315-8a25-4ebd-9518-d267b7d51682 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
25512024-11-28T05:00:40.862ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37873
25522024-11-28T05:00:40.862ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37873 req_id = fe4f4ea4-fbe5-4531-a5f9-98b0a404a502 response_code = 200 uri = /baseboard
25532024-11-28T05:00:54.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64521
25542024-11-28T05:00:54.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64521 req_id = f568adad-c20d-4e4d-81f6-6e90ec1816df response_code = 200 uri = /vpc-routes
25552024-11-28T05:00:54.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58161
25562024-11-28T05:00:54.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58161 req_id = c1bed1fb-c872-4644-838e-30e1e21a972d response_code = 200 uri = /vpc-routes
25572024-11-28T05:00:54.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41065
25582024-11-28T05:00:54.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41065 req_id = 5a5ecde8-8eac-4a3e-993f-c980c2575a70 response_code = 200 uri = /vpc-routes
25592024-11-28T05:00:54.811ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
25602024-11-28T05:00:54.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58161 req_id = f1988ea5-ea84-4ac1-80d0-04a90a45ae1c response_code = 204 uri = /eip-gateways
25612024-11-28T05:00:54.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58161 req_id = 7cc38aba-4e48-4f3e-9906-b228e517bcfb response_code = 204 uri = /vpc-routes
25622024-11-28T05:00:54.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
25632024-11-28T05:00:54.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64521 req_id = 8cea8ce7-3799-42f7-a96b-142eff3d45a5 response_code = 204 uri = /eip-gateways
25642024-11-28T05:00:54.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64521 req_id = 0e314eb0-bd6c-4146-ba4f-b0dba4583ea4 response_code = 204 uri = /vpc-routes
25652024-11-28T05:00:54.880ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
25662024-11-28T05:00:54.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41065 req_id = cbd8ffcf-54a2-41d3-b147-37906eba6508 response_code = 204 uri = /eip-gateways
25672024-11-28T05:00:54.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41065 req_id = 7546d609-40d6-4ba7-8f78-819f446c13ee response_code = 204 uri = /vpc-routes
25682024-11-28T05:00:54.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42603
25692024-11-28T05:00:54.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42603 req_id = e2ca9cb8-a9e4-44ca-b0b9-5e9ff83e6f20 response_code = 200 uri = /v2p
25702024-11-28T05:00:54.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37119
25712024-11-28T05:00:54.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37119 req_id = 10fd5e73-455d-4a73-8ef1-4d6c8a494f52 response_code = 200 uri = /v2p
25722024-11-28T05:00:54.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37409
25732024-11-28T05:00:54.983ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25742024-11-28T05:00:55.018ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25752024-11-28T05:00:55.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37409 req_id = 92edef60-0939-4c19-8c26-91c607a852b0 response_code = 204 uri = /switch-ports
25762024-11-28T05:00:55.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38162
25772024-11-28T05:00:55.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41282
25782024-11-28T05:00:55.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60637
25792024-11-28T05:00:55.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60637 req_id = 92164ba5-2f69-45d0-aae9-a19892a8a61c response_code = 200 uri = /v2p
25802024-11-28T05:00:55.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25812024-11-28T05:00:55.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37409 req_id = d5480799-b5d8-4b4c-b314-19dcde42c516 response_code = 200 uri = /network-bootstore-config
25822024-11-28T05:00:55.107ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25832024-11-28T05:00:55.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25842024-11-28T05:00:55.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87081 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41282 req_id = a20e6555-38b3-4a91-9a2d-3b60775da859 response_code = 204 uri = /switch-ports
25852024-11-28T05:00:55.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 648 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41282 req_id = 0ed742e5-cfce-4f14-8e02-a72022f85522 response_code = 200 uri = /network-bootstore-config
25862024-11-28T05:00:55.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25872024-11-28T05:00:55.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38162 req_id = 20fdffc1-0299-4631-9294-d9b4d1d2831d response_code = 204 uri = /switch-ports
25882024-11-28T05:00:55.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38162 req_id = 8122a577-bc4f-4cd1-b9a6-f39659aa305e response_code = 200 uri = /network-bootstore-config
25892024-11-28T05:01:06.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6909 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = f80b2349-4b67-4fd8-87a1-8d8cb1332324 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
25902024-11-28T05:01:10.896ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52011
25912024-11-28T05:01:10.896ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52011 req_id = 497db7a1-4b2e-4b33-b937-114e3c56670e response_code = 200 uri = /baseboard
25922024-11-28T05:01:24.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40914
25932024-11-28T05:01:24.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40914 req_id = a1e8241f-5d5c-4c3d-8578-08fc30f90490 response_code = 200 uri = /vpc-routes
25942024-11-28T05:01:24.641ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
25952024-11-28T05:01:24.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40914 req_id = 98eac502-3b06-4975-8f6c-2e0db903107e response_code = 204 uri = /eip-gateways
25962024-11-28T05:01:24.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40914 req_id = 36f7ea02-eefc-4f07-84b1-03c31374fd5e response_code = 204 uri = /vpc-routes
25972024-11-28T05:01:24.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34787
25982024-11-28T05:01:24.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34787 req_id = 0e1390e2-8bd6-4985-b451-49831ad474ff response_code = 200 uri = /vpc-routes
25992024-11-28T05:01:24.713ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
26002024-11-28T05:01:24.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34787 req_id = 4e9a83bd-b7c0-4923-a53d-cd5cdda6b6e2 response_code = 204 uri = /eip-gateways
26012024-11-28T05:01:24.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34787 req_id = 580bbc1c-47ca-4ba9-8a0f-cec04c1ccd33 response_code = 204 uri = /vpc-routes
26022024-11-28T05:01:24.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54451
26032024-11-28T05:01:24.735ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26042024-11-28T05:01:24.778ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26052024-11-28T05:01:24.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109501 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54451 req_id = 8907b105-278a-4455-b55f-d522521b8a3f response_code = 204 uri = /switch-ports
26062024-11-28T05:01:24.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59269
26072024-11-28T05:01:24.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45039
26082024-11-28T05:01:24.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64451
26092024-11-28T05:01:24.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64451 req_id = 66bca834-00d2-4bf4-82fa-e0d54fea0ecf response_code = 200 uri = /v2p
26102024-11-28T05:01:24.845ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26112024-11-28T05:01:24.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59269 req_id = 53185548-8c9f-455e-8fcb-44403ab4dd36 response_code = 200 uri = /v2p
26122024-11-28T05:01:24.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54451 req_id = 037ae3af-fee5-481d-b70f-7feb0a86f10d response_code = 200 uri = /network-bootstore-config
26132024-11-28T05:01:24.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39750
26142024-11-28T05:01:24.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39750 req_id = 9462dcfc-5a25-4070-a17e-147bb38573f4 response_code = 200 uri = /vpc-routes
26152024-11-28T05:01:24.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26162024-11-28T05:01:24.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
26172024-11-28T05:01:24.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39750 req_id = 032ae9d2-c0be-486e-ba9c-c00e6213774d response_code = 204 uri = /eip-gateways
26182024-11-28T05:01:24.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39750 req_id = 978c89ba-077e-42ad-b552-c189d563e055 response_code = 204 uri = /vpc-routes
26192024-11-28T05:01:24.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34221
26202024-11-28T05:01:24.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43378
26212024-11-28T05:01:24.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43378 req_id = 22cb8168-7bc3-42d8-bb19-4f07fe741a45 response_code = 200 uri = /v2p
26222024-11-28T05:01:24.939ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26232024-11-28T05:01:24.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94019 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45039 req_id = c414faee-2403-4b80-869d-ff415bb6eb6b response_code = 204 uri = /switch-ports
26242024-11-28T05:01:24.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45039 req_id = db3fc659-1142-4c82-84ea-fbe0cb2897f5 response_code = 200 uri = /network-bootstore-config
26252024-11-28T05:01:24.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26262024-11-28T05:01:25.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34221 req_id = 36c9c348-5f33-4ce9-b3e3-09a92de49f02 response_code = 204 uri = /switch-ports
26272024-11-28T05:01:25.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34221 req_id = 0705ed61-1d43-4634-bf7b-2290d4107b9e response_code = 200 uri = /network-bootstore-config
26282024-11-28T05:01:36.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6911 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 8a34ba5e-7c97-4cad-84fa-a701795f9350 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
26292024-11-28T05:01:40.929ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54422
26302024-11-28T05:01:40.929ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54422 req_id = d524c1e3-2627-48d1-99a4-dc27b8c6b7ec response_code = 200 uri = /baseboard
26312024-11-28T05:01:54.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56735
26322024-11-28T05:01:54.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56735 req_id = 299d2597-16a4-4e3a-9711-a4e83e7834a7 response_code = 200 uri = /vpc-routes
26332024-11-28T05:01:54.863ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
26342024-11-28T05:01:54.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56735 req_id = 2990e393-97fc-4b8d-a6b0-bd6165ddcdc8 response_code = 204 uri = /eip-gateways
26352024-11-28T05:01:54.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56735 req_id = 475925a9-a5c2-4350-bd2c-fe5c54cb834c response_code = 204 uri = /vpc-routes
26362024-11-28T05:01:54.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56899
26372024-11-28T05:01:54.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56899 req_id = a60e861c-d6b4-44ca-be9e-a27d07c13f1a response_code = 200 uri = /v2p
26382024-11-28T05:01:54.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55503
26392024-11-28T05:01:54.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55503 req_id = c63308b6-8549-45fe-9311-d22df7a9b0a7 response_code = 200 uri = /vpc-routes
26402024-11-28T05:01:54.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40551
26412024-11-28T05:01:54.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40551 req_id = a850d5ba-a398-42a6-a561-f202287574d9 response_code = 200 uri = /vpc-routes
26422024-11-28T05:01:54.974ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
26432024-11-28T05:01:54.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55503 req_id = dd5ffc36-6063-48a3-a21a-b36bc3dbddf4 response_code = 204 uri = /eip-gateways
26442024-11-28T05:01:54.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
26452024-11-28T05:01:54.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40551 req_id = bb12b507-6e47-4d53-936e-66db3ff647a5 response_code = 204 uri = /eip-gateways
26462024-11-28T05:01:54.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55503 req_id = 7eebbcfd-184f-4374-bb38-47c43f359dee response_code = 204 uri = /vpc-routes
26472024-11-28T05:01:54.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40551 req_id = f42c2294-33be-4966-91c4-6bd3f7d8cde9 response_code = 204 uri = /vpc-routes
26482024-11-28T05:01:55.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48278
26492024-11-28T05:01:55.005ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26502024-11-28T05:01:55.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26512024-11-28T05:01:55.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48278 req_id = a1c2b6f3-af90-4386-b8f0-cc03743ba50c response_code = 204 uri = /switch-ports
26522024-11-28T05:01:55.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48278 req_id = 7eea0bf8-dbd3-441c-95bd-759fa8560bdc response_code = 200 uri = /network-bootstore-config
26532024-11-28T05:01:55.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41329
26542024-11-28T05:01:55.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41329 req_id = 5427e968-d781-41e8-8b14-14fc9fbed315 response_code = 200 uri = /v2p
26552024-11-28T05:01:55.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50256
26562024-11-28T05:01:55.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50256 req_id = 625faa63-6990-4a4c-9f3a-0b3025d68786 response_code = 200 uri = /v2p
26572024-11-28T05:01:55.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63844
26582024-11-28T05:01:55.224ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26592024-11-28T05:01:55.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26602024-11-28T05:01:55.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87193 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63844 req_id = 708aee5a-c3c8-41b8-9869-c76fb551f81a response_code = 204 uri = /switch-ports
26612024-11-28T05:01:55.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64090
26622024-11-28T05:01:55.311ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26632024-11-28T05:01:55.344ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26642024-11-28T05:01:55.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84079 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64090 req_id = b9c5283b-1c8d-47c9-a641-91ace2e51d58 response_code = 204 uri = /switch-ports
26652024-11-28T05:01:55.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63844 req_id = fda1a9b0-7266-4a30-ad2f-c1d171eb0e6c response_code = 200 uri = /network-bootstore-config
26662024-11-28T05:01:55.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64090 req_id = d3549b28-fd10-4fef-aea7-66dcb7c2c8c6 response_code = 200 uri = /network-bootstore-config
26672024-11-28T05:02:06.519ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7092 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 8ce0246c-bdc3-4fc0-b55e-4a7698a14f2d response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
26682024-11-28T05:02:10.961ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34578
26692024-11-28T05:02:10.961ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34578 req_id = 86760870-05bd-46f8-ba08-a632329f9fbc response_code = 200 uri = /baseboard
26702024-11-28T05:02:24.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50064
26712024-11-28T05:02:24.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50064 req_id = f3c245a5-8ce2-436c-aab5-c58c7a307c48 response_code = 200 uri = /vpc-routes
26722024-11-28T05:02:24.649ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
26732024-11-28T05:02:24.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50064 req_id = c5c18b4f-4060-416b-b63d-c50d5ff61169 response_code = 204 uri = /eip-gateways
26742024-11-28T05:02:24.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38343
26752024-11-28T05:02:24.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38343 req_id = abca4d4a-59bb-4c5f-a5fc-cc30bfc44adf response_code = 200 uri = /vpc-routes
26762024-11-28T05:02:24.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62553
26772024-11-28T05:02:24.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62553 req_id = d9ef5a2f-fbf5-4aba-ace0-bbf90b6fbef4 response_code = 200 uri = /v2p
26782024-11-28T05:02:24.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50064 req_id = 8c38002f-f889-476e-95e4-b51dd9a1f2ee response_code = 204 uri = /vpc-routes
26792024-11-28T05:02:24.721ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
26802024-11-28T05:02:24.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38343 req_id = 7f5ab7b2-2d70-46ad-bca7-b82e17cf6e5a response_code = 204 uri = /eip-gateways
26812024-11-28T05:02:24.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38343 req_id = 613fe68c-3a49-400d-80e7-d056b476f233 response_code = 204 uri = /vpc-routes
26822024-11-28T05:02:24.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43851
26832024-11-28T05:02:24.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26842024-11-28T05:02:24.776ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26852024-11-28T05:02:24.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43851 req_id = adeef38a-83ec-44b2-8511-97a53ffc5cd1 response_code = 204 uri = /switch-ports
26862024-11-28T05:02:24.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44189
26872024-11-28T05:02:24.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58214
26882024-11-28T05:02:24.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58214 req_id = 769ffffa-dc1a-4199-b2fe-d0223751aea6 response_code = 200 uri = /vpc-routes
26892024-11-28T05:02:24.838ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26902024-11-28T05:02:24.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43851 req_id = c8654bb8-41a4-4aa0-b10f-ca4f7e0efa3a response_code = 200 uri = /network-bootstore-config
26912024-11-28T05:02:24.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49298
26922024-11-28T05:02:24.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49298 req_id = f39e6f10-2287-48c4-ba0d-afcbae3409fd response_code = 200 uri = /v2p
26932024-11-28T05:02:24.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
26942024-11-28T05:02:24.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58214 req_id = 8dc449d2-7bc7-479b-b3ae-80de7735af61 response_code = 204 uri = /eip-gateways
26952024-11-28T05:02:24.879ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26962024-11-28T05:02:24.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58214 req_id = 8a981029-274c-46c3-9a83-3278c03fdaed response_code = 204 uri = /vpc-routes
26972024-11-28T05:02:24.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53563
26982024-11-28T05:02:24.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26992024-11-28T05:02:24.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44189 req_id = 98b1e08c-4c9f-42fe-8f3b-adda1551a64e response_code = 204 uri = /switch-ports
27002024-11-28T05:02:24.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 685 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44189 req_id = 5fbdd257-07a1-4eaf-a99c-7dacc74bfeb9 response_code = 200 uri = /network-bootstore-config
27012024-11-28T05:02:24.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27022024-11-28T05:02:24.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55319
27032024-11-28T05:02:24.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55319 req_id = 1b0cda52-06e2-4f5d-82dd-d6350dea57cc response_code = 200 uri = /v2p
27042024-11-28T05:02:25.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132197 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53563 req_id = 18e573a8-63e2-4f4a-a494-ccef339129d4 response_code = 204 uri = /switch-ports
27052024-11-28T05:02:25.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53563 req_id = df77c520-f65c-4ec7-93ed-4c6ac02f7755 response_code = 200 uri = /network-bootstore-config
27062024-11-28T05:02:36.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6915 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 885ed216-7516-4174-94a9-74745442fd1c response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
27072024-11-28T05:02:40.995ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49026
27082024-11-28T05:02:40.995ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49026 req_id = 6aac62f1-10b9-4ba1-a05a-429ff4e15861 response_code = 200 uri = /baseboard
27092024-11-28T05:02:54.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45206
27102024-11-28T05:02:54.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45206 req_id = 832c84d7-f2a7-4397-9077-4dfeb6add8fb response_code = 200 uri = /vpc-routes
27112024-11-28T05:02:54.826ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
27122024-11-28T05:02:54.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45206 req_id = 203c4469-61a5-4e57-b74c-22da5bd90f4a response_code = 204 uri = /eip-gateways
27132024-11-28T05:02:54.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45206 req_id = 7c7aa12e-c7af-4214-8b7e-8bd3065dabeb response_code = 204 uri = /vpc-routes
27142024-11-28T05:02:54.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41023
27152024-11-28T05:02:54.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41023 req_id = 481aade6-718c-404b-a1b0-20af0326b715 response_code = 200 uri = /vpc-routes
27162024-11-28T05:02:54.901ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
27172024-11-28T05:02:54.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41023 req_id = daa8fa56-2d23-4610-a82c-bd76ca2f5213 response_code = 204 uri = /eip-gateways
27182024-11-28T05:02:54.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41023 req_id = 20f4aad5-31ab-448d-afde-f13d2be7bad1 response_code = 204 uri = /vpc-routes
27192024-11-28T05:02:54.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44742
27202024-11-28T05:02:54.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44742 req_id = 7edd140b-fa52-420d-b992-1c1cc69aed6f response_code = 200 uri = /vpc-routes
27212024-11-28T05:02:54.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58066
27222024-11-28T05:02:54.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58066 req_id = a082e09e-a7d6-4b1b-aa30-f81c89d5b80c response_code = 200 uri = /v2p
27232024-11-28T05:02:54.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43021
27242024-11-28T05:02:54.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43021 req_id = 8ae00552-5136-479a-80e4-15e4bacd1014 response_code = 200 uri = /v2p
27252024-11-28T05:02:54.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52866
27262024-11-28T05:02:54.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52866 req_id = 0aa3681d-1826-4d33-a481-bb9a14bf6143 response_code = 200 uri = /v2p
27272024-11-28T05:02:55.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
27282024-11-28T05:02:55.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44742 req_id = 95d373ec-de38-4ee3-8e4d-0507afcd9d9a response_code = 204 uri = /eip-gateways
27292024-11-28T05:02:55.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44742 req_id = b18e53f4-947b-49a6-87e6-8da942afda1e response_code = 204 uri = /vpc-routes
27302024-11-28T05:02:55.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41702
27312024-11-28T05:02:55.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27322024-11-28T05:02:55.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27332024-11-28T05:02:55.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41702 req_id = 3a3a9cb5-0c06-4a1d-ab89-a3d92733e3fe response_code = 204 uri = /switch-ports
27342024-11-28T05:02:55.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49676
27352024-11-28T05:02:55.124ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27362024-11-28T05:02:55.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27372024-11-28T05:02:55.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49676 req_id = 4a5abf8b-078c-4f11-920e-49f663cd2c83 response_code = 204 uri = /switch-ports
27382024-11-28T05:02:55.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56726
27392024-11-28T05:02:55.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41702 req_id = 85bf0f24-7f8b-462d-81e0-8c4868dde0fc response_code = 200 uri = /network-bootstore-config
27402024-11-28T05:02:55.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49676 req_id = bd90e88e-417a-45c5-9974-2181f33313a5 response_code = 200 uri = /network-bootstore-config
27412024-11-28T05:02:55.215ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27422024-11-28T05:02:55.252ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27432024-11-28T05:02:55.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89592 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56726 req_id = 0bcbb841-e759-4332-bcac-75f07c0f4efc response_code = 204 uri = /switch-ports
27442024-11-28T05:02:55.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56726 req_id = 42b7914f-8ff6-4f80-b527-6f6083f06a53 response_code = 200 uri = /network-bootstore-config
27452024-11-28T05:03:06.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6852 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 492a4394-65a9-4fa0-97d2-904a93a20146 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
27462024-11-28T05:03:11.027ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57333
27472024-11-28T05:03:11.028ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57333 req_id = 2dad3069-ecee-405f-acc1-f9d7dc759ce0 response_code = 200 uri = /baseboard
27482024-11-28T05:03:24.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48418
27492024-11-28T05:03:24.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48418 req_id = 94002235-890e-4a22-9c23-c722aff622c7 response_code = 200 uri = /vpc-routes
27502024-11-28T05:03:24.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
27512024-11-28T05:03:24.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48418 req_id = 4cf7b3fb-5182-45f8-ba38-7cfd74aaf2cb response_code = 204 uri = /eip-gateways
27522024-11-28T05:03:24.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48418 req_id = 30262259-ce4b-40e6-b496-05d071867474 response_code = 204 uri = /vpc-routes
27532024-11-28T05:03:24.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47476
27542024-11-28T05:03:24.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47476 req_id = 2364ac53-2845-4d13-8c3b-d3b179a38ddf response_code = 200 uri = /vpc-routes
27552024-11-28T05:03:24.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
27562024-11-28T05:03:24.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47476 req_id = 2347cef7-2ab1-4f3a-82ec-7a6a508f734c response_code = 204 uri = /eip-gateways
27572024-11-28T05:03:24.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47476 req_id = 26a80679-1776-4bbf-8e5b-ff8adc050156 response_code = 204 uri = /vpc-routes
27582024-11-28T05:03:24.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60188
27592024-11-28T05:03:24.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60188 req_id = 7cdd4ff3-c4b0-4420-a9bd-10d1419ad67a response_code = 200 uri = /v2p
27602024-11-28T05:03:24.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36897
27612024-11-28T05:03:24.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36897 req_id = 9484756e-1d33-4e94-94a0-a6942b1e4fec response_code = 200 uri = /v2p
27622024-11-28T05:03:24.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61829
27632024-11-28T05:03:24.768ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27642024-11-28T05:03:24.804ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27652024-11-28T05:03:24.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61829 req_id = 217e6089-5a35-4625-809b-98238273732c response_code = 204 uri = /switch-ports
27662024-11-28T05:03:24.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56416
27672024-11-28T05:03:24.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27682024-11-28T05:03:24.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61829 req_id = e9f116ee-a18c-4753-aeb6-cd85cd11b62a response_code = 200 uri = /network-bootstore-config
27692024-11-28T05:03:24.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27702024-11-28T05:03:24.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58398
27712024-11-28T05:03:24.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58398 req_id = 1fd59b4e-aa63-438e-95d7-4b62fb72e6a1 response_code = 200 uri = /vpc-routes
27722024-11-28T05:03:24.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92600 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56416 req_id = 69524281-975e-4bef-b098-2bcc6317f340 response_code = 204 uri = /switch-ports
27732024-11-28T05:03:24.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56416 req_id = d71b5962-11bc-462d-abe1-046cc30e3013 response_code = 200 uri = /network-bootstore-config
27742024-11-28T05:03:24.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
27752024-11-28T05:03:24.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58398 req_id = 5c961057-76c2-439c-bb7c-f2f8088297c5 response_code = 204 uri = /eip-gateways
27762024-11-28T05:03:24.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58398 req_id = 53f249ed-3b40-4d9f-89c1-28dc6db39e82 response_code = 204 uri = /vpc-routes
27772024-11-28T05:03:24.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44317
27782024-11-28T05:03:24.995ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27792024-11-28T05:03:25.032ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27802024-11-28T05:03:25.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85482 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44317 req_id = baf95d21-80f7-48d7-80e4-3d1da944ec13 response_code = 204 uri = /switch-ports
27812024-11-28T05:03:25.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58724
27822024-11-28T05:03:25.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58724 req_id = 9af85be1-40b2-4185-9006-be88e9ab8726 response_code = 200 uri = /v2p
27832024-11-28T05:03:25.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44317 req_id = 07016cfc-07c5-47a9-ab20-c4fd2668205e response_code = 200 uri = /network-bootstore-config
27842024-11-28T05:03:36.521ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9712 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 341da99f-cbdd-4d61-a871-6955bd78f704 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
27852024-11-28T05:03:41.060ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57990
27862024-11-28T05:03:41.060ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57990 req_id = a6697478-71b0-442d-a8d5-8d6a95d73d53 response_code = 200 uri = /baseboard
27872024-11-28T05:03:54.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38548
27882024-11-28T05:03:54.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38548 req_id = b36cb68e-19fa-4fc9-8ded-93717be53274 response_code = 200 uri = /vpc-routes
27892024-11-28T05:03:54.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
27902024-11-28T05:03:54.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38548 req_id = 76710a1b-64e6-46d8-9c36-48bbd74f06ab response_code = 204 uri = /eip-gateways
27912024-11-28T05:03:54.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38548 req_id = 9a504386-f3d8-424b-abdb-d112a2f64922 response_code = 204 uri = /vpc-routes
27922024-11-28T05:03:54.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55804
27932024-11-28T05:03:54.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55804 req_id = d24a319c-352e-48cc-a40a-e199447de7de response_code = 200 uri = /vpc-routes
27942024-11-28T05:03:54.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37231
27952024-11-28T05:03:54.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37231 req_id = 260123d9-283e-477d-9bcc-8413f2a3e55a response_code = 200 uri = /v2p
27962024-11-28T05:03:54.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59680
27972024-11-28T05:03:54.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59680 req_id = f04427ae-7bad-47b8-8382-f509b7497df7 response_code = 200 uri = /v2p
27982024-11-28T05:03:54.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63768
27992024-11-28T05:03:54.966ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28002024-11-28T05:03:54.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28012024-11-28T05:03:54.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28022024-11-28T05:03:54.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28032024-11-28T05:03:54.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28042024-11-28T05:03:54.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28052024-11-28T05:03:54.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28062024-11-28T05:03:54.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63768 req_id = 81578735-c1aa-45df-9304-efdb519e6a2a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28072024-11-28T05:03:54.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45416
28082024-11-28T05:03:54.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45416 req_id = 33ce23c2-11e7-4218-89e4-3cf272ef449e response_code = 200 uri = /vpc-routes
28092024-11-28T05:03:54.989ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
28102024-11-28T05:03:54.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55804 req_id = 5b0f7216-7008-41e5-bbc0-5be100cee177 response_code = 204 uri = /eip-gateways
28112024-11-28T05:03:54.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55804 req_id = d71e2e7d-f72c-47d9-a430-7bfa3bdcb0cb response_code = 204 uri = /vpc-routes
28122024-11-28T05:03:55.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40726
28132024-11-28T05:03:55.004ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28142024-11-28T05:03:55.051ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28152024-11-28T05:03:55.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106648 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40726 req_id = 8fe35581-3005-44f5-a56f-d75299649b49 response_code = 204 uri = /switch-ports
28162024-11-28T05:03:55.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47440
28172024-11-28T05:03:55.111ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
28182024-11-28T05:03:55.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45416 req_id = 51a31990-e2d4-4d46-98d8-e17bc31b9aa1 response_code = 204 uri = /eip-gateways
28192024-11-28T05:03:55.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34588
28202024-11-28T05:03:55.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40726 req_id = c90bb452-194d-451a-bd95-1239ce7cdd03 response_code = 200 uri = /network-bootstore-config
28212024-11-28T05:03:55.112ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28222024-11-28T05:03:55.112ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28232024-11-28T05:03:55.112ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
28242024-11-28T05:03:55.112ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28252024-11-28T05:03:55.117ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
28262024-11-28T05:03:55.130ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28272024-11-28T05:03:55.130ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f498487-c0df-4538-adab-e17b7773b517
28282024-11-28T05:03:55.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28292024-11-28T05:03:55.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28302024-11-28T05:03:55.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3abe6613-feef-46d1-ade9-21289cb9be78
28312024-11-28T05:03:55.191ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28322024-11-28T05:03:55.191ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9
28332024-11-28T05:03:55.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37037
28342024-11-28T05:03:55.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37037 req_id = fb3de66d-a43a-43f0-9103-15a238607e9e response_code = 200 uri = /v2p
28352024-11-28T05:03:55.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52603
28362024-11-28T05:03:55.205ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28372024-11-28T05:03:55.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28382024-11-28T05:03:55.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28392024-11-28T05:03:55.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28402024-11-28T05:03:55.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28412024-11-28T05:03:55.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28422024-11-28T05:03:55.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28432024-11-28T05:03:55.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52603 req_id = ac43ea37-7d1a-44b1-afb4-0292b9797669 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28442024-11-28T05:03:55.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45416 req_id = 1d6fa9c6-7ea1-4135-a859-bd023cb40126 response_code = 204 uri = /vpc-routes
28452024-11-28T05:03:55.218ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28462024-11-28T05:03:55.218ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf
28472024-11-28T05:03:55.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40222
28482024-11-28T05:03:55.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111581 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34588 req_id = 0395150a-6ef4-4021-be8b-6bdf64a10059 response_code = 204 uri = /switch-ports
28492024-11-28T05:03:55.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34588 req_id = 39b1a7be-05c2-406a-957c-8e3afbd528ac response_code = 200 uri = /network-bootstore-config
28502024-11-28T05:03:55.232ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28512024-11-28T05:03:55.232ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28522024-11-28T05:03:55.232ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
28532024-11-28T05:03:55.236ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
28542024-11-28T05:03:55.243ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28552024-11-28T05:03:55.243ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c1ab70e5-120b-4db1-895c-564a6858dda1
28562024-11-28T05:03:55.259ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28572024-11-28T05:03:55.259ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f498487-c0df-4538-adab-e17b7773b517
28582024-11-28T05:03:55.284ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28592024-11-28T05:03:55.284ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3abe6613-feef-46d1-ade9-21289cb9be78
28602024-11-28T05:03:55.297ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28612024-11-28T05:03:55.297ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc
28622024-11-28T05:03:55.312ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28632024-11-28T05:03:55.313ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9
28642024-11-28T05:03:55.328ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28652024-11-28T05:03:55.328ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad
28662024-11-28T05:03:55.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59354
28672024-11-28T05:03:55.339ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28682024-11-28T05:03:55.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56349
28692024-11-28T05:03:55.350ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a86f973e-a1fb-466c-b1d8-f420a836d3b9, kind: Service { id: 91d815d7-9afa-45d8-a0f1-9deeaae8e60f }, name: Name("external-dns-91d815d7-9afa-45d8-a0f1-9deeaae8e60f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5b427cb-4a46-49a9-bf9f-c54fe8573c68, kind: Service { id: 5c8e639d-0b41-401f-a368-832f1887d4aa }, name: Name("external-dns-5c8e639d-0b41-401f-a368-832f1887d4aa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 206])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 58653aac-6bc7-4739-81f2-7d6daf21b4a6, kind: Service { id: 15c048e4-d934-4eb6-8bed-d5adc0f1a1b9 }, name: Name("nexus-15c048e4-d934-4eb6-8bed-d5adc0f1a1b9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 107])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5a5b6996-1c63-4404-90b4-d2025106f53c, kind: Service { id: 3f1b2e0e-2187-48c9-9a08-167823db7b61 }, name: Name("nexus-3f1b2e0e-2187-48c9-9a08-167823db7b61"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 175])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8960026f-89ef-43a7-8f39-11c1e5aee3d0, kind: Service { id: ae5f89dc-ceae-4347-960d-bb4e54db9bbd }, name: Name("nexus-ae5f89dc-ceae-4347-960d-bb4e54db9bbd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28702024-11-28T05:03:55.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28712024-11-28T05:03:55.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28722024-11-28T05:03:55.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28732024-11-28T05:03:55.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28742024-11-28T05:03:55.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28752024-11-28T05:03:55.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28762024-11-28T05:03:55.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56349 req_id = c5e4c116-b2af-4953-8c02-016bef243e59 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28772024-11-28T05:03:55.354ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28782024-11-28T05:03:55.354ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf
28792024-11-28T05:03:55.367ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28802024-11-28T05:03:55.367ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b
28812024-11-28T05:03:55.374ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28822024-11-28T05:03:55.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28832024-11-28T05:03:55.390ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33949fdd-4265-4f10-ab58-a876a4529485
28842024-11-28T05:03:55.401ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28852024-11-28T05:03:55.401ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c1ab70e5-120b-4db1-895c-564a6858dda1
28862024-11-28T05:03:55.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47440 req_id = 2c47a22b-9a80-442a-b8ca-b481e6fdb1ed response_code = 200 uri = /inventory
28872024-11-28T05:03:55.425ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28882024-11-28T05:03:55.425ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc
28892024-11-28T05:03:55.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94543 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59354 req_id = f38b42bf-a81c-4e4e-a875-d4d2034fcfa3 response_code = 204 uri = /switch-ports
28902024-11-28T05:03:55.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59354 req_id = 921964f5-8a3b-40cc-b438-b2b3b6e4bffb response_code = 200 uri = /network-bootstore-config
28912024-11-28T05:03:55.446ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28922024-11-28T05:03:55.446ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad
28932024-11-28T05:03:55.467ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28942024-11-28T05:03:55.467ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b
28952024-11-28T05:03:55.488ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28962024-11-28T05:03:55.488ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33949fdd-4265-4f10-ab58-a876a4529485
28972024-11-28T05:03:55.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278782 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40222 req_id = 30ef1a39-59f8-414b-9497-22596bdc679f response_code = 200 uri = /inventory
28982024-11-28T05:03:56.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49876
28992024-11-28T05:03:56.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29002024-11-28T05:03:56.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29012024-11-28T05:03:56.233ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/config/omicron-zones.json file = common/src/ledger.rs:177
29022024-11-28T05:03:56.233ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/config/omicron-zones.json file = common/src/ledger.rs:177
29032024-11-28T05:03:56.245ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4f498487-c0df-4538-adab-e17b7773b517 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29042024-11-28T05:03:56.245ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4f498487-c0df-4538-adab-e17b7773b517
29052024-11-28T05:03:56.269ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3abe6613-feef-46d1-ade9-21289cb9be78 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29062024-11-28T05:03:56.269ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3abe6613-feef-46d1-ade9-21289cb9be78
29072024-11-28T05:03:56.291ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cae3a0c5-81cb-482f-9ae7-1619fb0561c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29082024-11-28T05:03:56.291ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_cae3a0c5-81cb-482f-9ae7-1619fb0561c9
29092024-11-28T05:03:56.312ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4580e895-8d6e-45b1-823b-3db8fe32cccf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29102024-11-28T05:03:56.312ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4580e895-8d6e-45b1-823b-3db8fe32cccf
29112024-11-28T05:03:56.335ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c1ab70e5-120b-4db1-895c-564a6858dda1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29122024-11-28T05:03:56.335ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c1ab70e5-120b-4db1-895c-564a6858dda1
29132024-11-28T05:03:56.354ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46c9f34c-d4c5-49e7-81c2-324226caf2cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29142024-11-28T05:03:56.354ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_46c9f34c-d4c5-49e7-81c2-324226caf2cc
29152024-11-28T05:03:56.372ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6d0dec14-4f9a-4b89-a3ba-43f301b5efad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29162024-11-28T05:03:56.372ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6d0dec14-4f9a-4b89-a3ba-43f301b5efad
29172024-11-28T05:03:56.393ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 655b21d3-4cba-44ac-b0bc-c895494baa1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29182024-11-28T05:03:56.393ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_655b21d3-4cba-44ac-b0bc-c895494baa1b
29192024-11-28T05:03:56.416ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 33949fdd-4265-4f10-ab58-a876a4529485 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29202024-11-28T05:03:56.416ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_33949fdd-4265-4f10-ab58-a876a4529485
29212024-11-28T05:03:56.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196098 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49876 req_id = 872826c3-e5a5-4fd1-b208-0225836a09d4 response_code = 200 uri = /inventory
29222024-11-28T05:04:06.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6662 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 52271b40-ebc5-4d15-a4dd-44c3a05a33dc response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
29232024-11-28T05:04:11.092ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50117
29242024-11-28T05:04:11.093ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50117 req_id = e19a2bcf-91b5-41df-8489-afb968c54520 response_code = 200 uri = /baseboard
29252024-11-28T05:04:24.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59567
29262024-11-28T05:04:24.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59567 req_id = 5694619e-9921-441f-84d5-480c3e667e3e response_code = 200 uri = /vpc-routes
29272024-11-28T05:04:24.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
29282024-11-28T05:04:24.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59567 req_id = 7e8862e8-7402-49f1-950a-1b5e79ce57b7 response_code = 204 uri = /eip-gateways
29292024-11-28T05:04:24.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58058
29302024-11-28T05:04:24.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58058 req_id = ca56c6b4-15c5-4ad6-9efe-5381472ab7c9 response_code = 200 uri = /vpc-routes
29312024-11-28T05:04:24.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55758
29322024-11-28T05:04:24.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55758 req_id = 104b0184-8eaf-4e33-b3a3-804fba5ef6d6 response_code = 200 uri = /v2p
29332024-11-28T05:04:24.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59567 req_id = 82117ebf-b7c6-4f73-9649-017caec3a872 response_code = 204 uri = /vpc-routes
29342024-11-28T05:04:24.721ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
29352024-11-28T05:04:24.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58058 req_id = a561db43-df30-479f-8bf8-fe024ed34fce response_code = 204 uri = /eip-gateways
29362024-11-28T05:04:24.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58058 req_id = 4aa8e51a-3764-439f-b18d-b9049a6e9db1 response_code = 204 uri = /vpc-routes
29372024-11-28T05:04:24.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56463
29382024-11-28T05:04:24.747ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29392024-11-28T05:04:24.791ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29402024-11-28T05:04:24.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56463 req_id = 5671d47b-2d29-415f-9577-b07178e07499 response_code = 204 uri = /switch-ports
29412024-11-28T05:04:24.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52422
29422024-11-28T05:04:24.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52516
29432024-11-28T05:04:24.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52516 req_id = abb47385-23f9-44bf-a5a6-9a3e6fdad776 response_code = 200 uri = /vpc-routes
29442024-11-28T05:04:24.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29452024-11-28T05:04:24.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56463 req_id = 1359036e-b287-48c6-8818-d326e9690c01 response_code = 200 uri = /network-bootstore-config
29462024-11-28T05:04:24.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65145
29472024-11-28T05:04:24.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65145 req_id = c3df377f-31d8-4d84-8e03-d106503d3e59 response_code = 200 uri = /v2p
29482024-11-28T05:04:24.906ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29492024-11-28T05:04:24.918ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
29502024-11-28T05:04:24.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52516 req_id = ab3d55ef-ca67-48dc-82d7-2bf512de899c response_code = 204 uri = /eip-gateways
29512024-11-28T05:04:24.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52516 req_id = 419d92a3-fc8c-4e45-b0d3-97b99316d943 response_code = 204 uri = /vpc-routes
29522024-11-28T05:04:24.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56987
29532024-11-28T05:04:24.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52979
29542024-11-28T05:04:24.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52979 req_id = 3505c1e6-ffa2-47c8-9eca-98452503ca58 response_code = 200 uri = /v2p
29552024-11-28T05:04:24.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29562024-11-28T05:04:24.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52422 req_id = 0000564a-4a9e-41f1-95be-efeec20dc186 response_code = 204 uri = /switch-ports
29572024-11-28T05:04:24.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 827 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52422 req_id = cbcc72fd-2e57-42c2-bea5-4c0f4de29c8c response_code = 200 uri = /network-bootstore-config
29582024-11-28T05:04:25.016ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29592024-11-28T05:04:25.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138941 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56987 req_id = 7c537584-14fd-4f89-a71a-3adcfeaf369b response_code = 204 uri = /switch-ports
29602024-11-28T05:04:25.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56987 req_id = 2d5bc15f-fcc8-48b9-ad5d-43aebf8d5cfd response_code = 200 uri = /network-bootstore-config
29612024-11-28T05:04:30.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53821
29622024-11-28T05:04:30.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53821 req_id = 811cf7ad-6715-43df-9b81-bfdbc43246a4 response_code = 200 uri = /v2p
29632024-11-28T05:04:30.743ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(12693533) }
29642024-11-28T05:04:30.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1525 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53821 req_id = c2671363-eea7-4844-8e06-8df0ec80379e response_code = 204 uri = /v2p
29652024-11-28T05:04:30.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57578
29662024-11-28T05:04:30.912ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 19a18ebd-21b0-4cd9-97c8-a78e84497af6, kind: Instance { id: a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12693533), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19a18ebd-21b0-4cd9-97c8-a78e84497af6, kind: Instance { id: a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12693533), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19a18ebd-21b0-4cd9-97c8-a78e84497af6, kind: Instance { id: a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12693533), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12693533))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19a18ebd-21b0-4cd9-97c8-a78e84497af6, kind: Instance { id: a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12693533), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-c59099b771e", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 646b2d76-3c35-4319-8d94-b532633d5ad5, read_only_parent: Some(Volume { block_size: 512, id: 45f59027-07ca-4e75-8bb8-1c738fac9e32, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6664af25-5d95-47a1-bda4-58ac7242013f, key: Some("ZShEGNq+eL2WO/JMiGZgRBu6C1LY3qKj+wU84k9tsRI="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 646b2d76-3c35-4319-8d94-b532633d5ad5, key: Some("6z/04cmRd18qc0XqR0132v2ks2i6u1c0z37iLvhWCUQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::13]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-c59099b771e" }] }), cloud_init_bytes: Some(..) } instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 metadata = InstanceMetadata { silo_id: 06f924b7-b0aa-47cd-8400-53f700997120, project_id: ae670a5b-6bc7-4a39-b4c5-edd0f8b1ff01 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-28T05:04:30.900402213Z }
29672024-11-28T05:04:30.912ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 migration_id = None propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29682024-11-28T05:04:30.913ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 migration_id = None propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 19a18ebd-21b0-4cd9-97c8-a78e84497af6, kind: Instance { id: a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12693533), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19a18ebd-21b0-4cd9-97c8-a78e84497af6, kind: Instance { id: a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12693533), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19a18ebd-21b0-4cd9-97c8-a78e84497af6, kind: Instance { id: a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12693533), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12693533))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19a18ebd-21b0-4cd9-97c8-a78e84497af6, kind: Instance { id: a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12693533), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-c59099b771e", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 646b2d76-3c35-4319-8d94-b532633d5ad5, read_only_parent: Some(Volume { block_size: 512, id: 45f59027-07ca-4e75-8bb8-1c738fac9e32, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6664af25-5d95-47a1-bda4-58ac7242013f, key: Some("ZShEGNq+eL2WO/JMiGZgRBu6C1LY3qKj+wU84k9tsRI="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 646b2d76-3c35-4319-8d94-b532633d5ad5, key: Some("6z/04cmRd18qc0XqR0132v2ks2i6u1c0z37iLvhWCUQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::13]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-c59099b771e" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-28T05:04:30.900402213Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29692024-11-28T05:04:30.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14375 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57578 req_id = 623310d2-b586-49f2-a411-32a4a02a520a response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29702024-11-28T05:04:31.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34158
29712024-11-28T05:04:31.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7865 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34158 req_id = bf99e1a4-d76c-421e-a964-9a6aee9869fa response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9/state
29722024-11-28T05:04:31.064ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 12693533 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29732024-11-28T05:04:31.064ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29742024-11-28T05:04:31.100ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 file = illumos-utils/src/zone.rs:325 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29752024-11-28T05:04:31.124ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 file = illumos-utils/src/zone.rs:363 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29762024-11-28T05:04:31.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33733
29772024-11-28T05:04:31.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33733 req_id = fa8c51e7-c999-49c4-b6a3-2f3d59a02573 response_code = 200 uri = /vpc-routes
29782024-11-28T05:04:31.170ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {19a18ebd-21b0-4cd9-97c8-a78e84497af6: {10.151.2.175: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}, 10.151.2.176: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}}} }
29792024-11-28T05:04:32.836ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29802024-11-28T05:04:32.837ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone file = illumos-utils/src/running_zone.rs:488 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29812024-11-28T05:04:33.030ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 60.978282ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29822024-11-28T05:04:33.106ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 56.64287ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29832024-11-28T05:04:33.181ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 234.57965ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29842024-11-28T05:04:33.429ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 409.497454ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29852024-11-28T05:04:33.852ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 434.753748ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29862024-11-28T05:04:34.301ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 908.867044ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29872024-11-28T05:04:35.222ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 605.141357ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29882024-11-28T05:04:35.837ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 1.155657096s file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29892024-11-28T05:04:36.520ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8869 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = f5ce3b68-5a10-4f6f-86b2-bb61ec820ddd response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
29902024-11-28T05:04:37.005ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 705.958613ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29912024-11-28T05:04:37.722ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 516.341585ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 zone = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29922024-11-28T05:04:38.268ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 file = sled-agent/src/instance.rs:1786 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29932024-11-28T05:04:38.279ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 68.24645ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29942024-11-28T05:04:38.358ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 107.225771ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29952024-11-28T05:04:38.476ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 142.116112ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29962024-11-28T05:04:38.629ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9") failed: Property not found. retry in 556.479668ms file = illumos-utils/src/svc.rs:36 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29972024-11-28T05:04:39.198ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29982024-11-28T05:04:39.241ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
29992024-11-28T05:04:39.378ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
30002024-11-28T05:04:39.386ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
30012024-11-28T05:04:39.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8216017 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33733 req_id = e2ea2cad-d762-4349-844d-a6bbe74cd5d1 response_code = 204 uri = /eip-gateways
30022024-11-28T05:04:39.387ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-28T05:04:39.386830076Z } file = sled-agent/src/instance.rs:780 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
30032024-11-28T05:04:39.387ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-28T05:04:39.386830076Z } propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
30042024-11-28T05:04:39.387ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-28T05:04:39.386830076Z }, migration_in: None, migration_out: None }
30052024-11-28T05:04:39.435ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-28T05:04:39.435350503Z } file = sled-agent/src/instance.rs:780 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
30062024-11-28T05:04:39.435ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-28T05:04:39.435350503Z } propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
30072024-11-28T05:04:39.435ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-28T05:04:39.435350503Z }, migration_in: None, migration_out: None }
30082024-11-28T05:04:39.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 607 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33733 req_id = 03a59a52-3316-4713-b70b-ff4b1be67712 response_code = 204 uri = /vpc-routes
30092024-11-28T05:04:41.125ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34180
30102024-11-28T05:04:41.125ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34180 req_id = 80bac3e4-b295-4088-9e2b-414622195dba response_code = 200 uri = /baseboard
30112024-11-28T05:04:54.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59267
30122024-11-28T05:04:54.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42041
30132024-11-28T05:04:54.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42041 req_id = 673a1497-f7ae-42f6-aad6-ebfa7af5dc61 response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9/state
30142024-11-28T05:04:54.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59267 req_id = 742e644a-4c39-4eb9-9b14-8c185cce70fe response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9/state
30152024-11-28T05:04:54.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61591
30162024-11-28T05:04:54.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61591 req_id = cee41b7a-e8c3-48ef-8436-bddde0276da7 response_code = 200 uri = /vpc-routes
30172024-11-28T05:04:54.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42806
30182024-11-28T05:04:54.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42806 req_id = 1069ea31-8a3d-4892-864d-ab4b6e6b67d8 response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9/state
30192024-11-28T05:04:54.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {19a18ebd-21b0-4cd9-97c8-a78e84497af6: {10.151.2.175: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}, 10.151.2.176: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}}} }
30202024-11-28T05:04:54.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61591 req_id = 6a66a22a-b3e7-469d-a12e-6b7ff201b03c response_code = 204 uri = /eip-gateways
30212024-11-28T05:04:54.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54962
30222024-11-28T05:04:54.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54962 req_id = fcd2dc02-61bc-4d2d-bf66-475cf3c34662 response_code = 200 uri = /vpc-routes
30232024-11-28T05:04:54.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35452
30242024-11-28T05:04:54.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35452 req_id = c0c131f7-112f-4268-b21f-afe6ce47a7a2 response_code = 200 uri = /v2p
30252024-11-28T05:04:54.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61591 req_id = 3f21de56-67c2-4212-bcd1-80663a782b75 response_code = 204 uri = /vpc-routes
30262024-11-28T05:04:54.960ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {19a18ebd-21b0-4cd9-97c8-a78e84497af6: {10.151.2.176: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}, 10.151.2.175: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}}} }
30272024-11-28T05:04:54.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54962 req_id = 054987fa-b794-4673-b465-67600cfd4c7e response_code = 204 uri = /eip-gateways
30282024-11-28T05:04:54.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54962 req_id = 1bc75d3e-f0f4-4aab-9b3b-31303fba961b response_code = 204 uri = /vpc-routes
30292024-11-28T05:04:55.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52701
30302024-11-28T05:04:55.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52701 req_id = d288b897-b82b-4b57-bdbe-624282fda151 response_code = 200 uri = /v2p
30312024-11-28T05:04:55.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61162
30322024-11-28T05:04:55.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30332024-11-28T05:04:55.100ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30342024-11-28T05:04:55.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61162 req_id = b8e3748c-de08-4064-a893-2c1a7088ece4 response_code = 204 uri = /switch-ports
30352024-11-28T05:04:55.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40819
30362024-11-28T05:04:55.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57260
30372024-11-28T05:04:55.166ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30382024-11-28T05:04:55.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57260 req_id = 3e58f8f6-f195-4be0-b118-18ae9aa83277 response_code = 200 uri = /vpc-routes
30392024-11-28T05:04:55.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61162 req_id = 7b98200b-167f-4b83-9cff-938ea713a34d response_code = 200 uri = /network-bootstore-config
30402024-11-28T05:04:55.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34549
30412024-11-28T05:04:55.208ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30422024-11-28T05:04:55.216ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {19a18ebd-21b0-4cd9-97c8-a78e84497af6: {10.151.2.175: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}, 10.151.2.176: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}}} }
30432024-11-28T05:04:55.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57260 req_id = 58417921-e65d-4dc8-8a47-892d64a25ec6 response_code = 204 uri = /eip-gateways
30442024-11-28T05:04:55.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35706
30452024-11-28T05:04:55.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35706 req_id = 86452722-40e2-4056-8c53-3dd07687cefe response_code = 200 uri = /v2p
30462024-11-28T05:04:55.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1023 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57260 req_id = cdb898ba-1d90-4bd4-ba9e-d56bbe2482a8 response_code = 204 uri = /vpc-routes
30472024-11-28T05:04:55.265ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30482024-11-28T05:04:55.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40819 req_id = 9bb3dafd-6b63-476c-9ca8-e663c925e2a7 response_code = 204 uri = /switch-ports
30492024-11-28T05:04:55.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 727 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40819 req_id = b46023c6-e6fe-4eaf-8b6c-c3760675125b response_code = 200 uri = /network-bootstore-config
30502024-11-28T05:04:55.298ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30512024-11-28T05:04:55.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167526 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34549 req_id = bb732d39-cc49-4cbd-9c4e-c907ff923875 response_code = 204 uri = /switch-ports
30522024-11-28T05:04:55.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34549 req_id = 92f9c6ea-ebfb-4da0-83d2-159bcf6c9e95 response_code = 200 uri = /network-bootstore-config
30532024-11-28T05:05:04.047ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30542024-11-28T05:05:06.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7755 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = 5b60091a-ad52-4128-a66b-57ab7f13c2dd response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
30552024-11-28T05:05:11.157ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46178
30562024-11-28T05:05:11.157ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46178 req_id = 07cbcb34-9fb2-4cb6-8dc3-2727a0291f44 response_code = 200 uri = /baseboard
30572024-11-28T05:05:24.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50473
30582024-11-28T05:05:24.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50473 req_id = 5f2cbfc7-cc8a-4ef0-a120-d37b1f078ec6 response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9/state
30592024-11-28T05:05:24.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52416
30602024-11-28T05:05:24.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52416 req_id = 93b2077d-f9d2-4eaa-9b9c-32de919a2957 response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9/state
30612024-11-28T05:05:24.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58735
30622024-11-28T05:05:24.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58735 req_id = 77d7e2dd-ef4a-4b41-b417-4f1917087e39 response_code = 200 uri = /vpc-routes
30632024-11-28T05:05:24.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {19a18ebd-21b0-4cd9-97c8-a78e84497af6: {10.151.2.175: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}, 10.151.2.176: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}}} }
30642024-11-28T05:05:24.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58735 req_id = 39779744-6b19-448a-8c43-e59016c3161e response_code = 204 uri = /eip-gateways
30652024-11-28T05:05:24.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58735 req_id = 65979c30-6ebf-4766-93d8-38478c2723b1 response_code = 204 uri = /vpc-routes
30662024-11-28T05:05:24.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59929
30672024-11-28T05:05:24.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59929 req_id = d4309df6-01ea-49c2-b014-c09bc7ae1be7 response_code = 200 uri = /vpc-routes
30682024-11-28T05:05:24.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33004
30692024-11-28T05:05:24.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30702024-11-28T05:05:24.843ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30712024-11-28T05:05:24.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99946 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33004 req_id = d4bca614-9ccc-48c6-89a5-4ef099c7d901 response_code = 204 uri = /switch-ports
30722024-11-28T05:05:24.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58544
30732024-11-28T05:05:24.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45446
30742024-11-28T05:05:24.902ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {19a18ebd-21b0-4cd9-97c8-a78e84497af6: {10.151.2.175: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}, 10.151.2.176: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}}} }
30752024-11-28T05:05:24.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35405
30762024-11-28T05:05:24.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59929 req_id = 0f7d3419-d013-4cf6-9ec9-0c77e91ffffd response_code = 204 uri = /eip-gateways
30772024-11-28T05:05:24.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58182
30782024-11-28T05:05:24.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60660
30792024-11-28T05:05:24.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33004 req_id = f8d44295-7194-42c6-95a8-446938a35934 response_code = 200 uri = /network-bootstore-config
30802024-11-28T05:05:24.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58544 req_id = 4e0c48d9-77bf-4017-8856-50db205a03ef response_code = 200 uri = /v2p
30812024-11-28T05:05:24.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45446 req_id = 51b07417-569a-4f57-8173-7cbab157ef56 response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9/state
30822024-11-28T05:05:24.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60660 req_id = 68e13da8-f588-4c1b-8cd8-193f2dcecb23 response_code = 200 uri = /vpc-routes
30832024-11-28T05:05:24.903ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30842024-11-28T05:05:24.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4935 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58182 req_id = 5f599781-2624-42e1-991c-fd2dbf19387c response_code = 200 uri = /v2p
30852024-11-28T05:05:24.921ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {19a18ebd-21b0-4cd9-97c8-a78e84497af6: {10.151.2.176: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}, 10.151.2.175: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}}} }
30862024-11-28T05:05:24.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60660 req_id = e25cb7e5-cb25-495f-85e9-e11ecac31f69 response_code = 204 uri = /eip-gateways
30872024-11-28T05:05:24.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58362
30882024-11-28T05:05:24.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58362 req_id = 15666f18-1c32-4b9c-b06a-6af1a128a9f2 response_code = 200 uri = /v2p
30892024-11-28T05:05:24.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 790 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59929 req_id = 8a9be904-1009-456e-9bb9-2e33f0df12d1 response_code = 204 uri = /vpc-routes
30902024-11-28T05:05:24.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60660 req_id = 89e53763-1399-4ce8-a8db-87ea1ac849ed response_code = 204 uri = /vpc-routes
30912024-11-28T05:05:24.943ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30922024-11-28T05:05:24.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63223
30932024-11-28T05:05:24.998ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30942024-11-28T05:05:24.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95273 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35405 req_id = 9aa3b883-2786-4c74-b60f-b7357d0b84be response_code = 204 uri = /switch-ports
30952024-11-28T05:05:25.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35405 req_id = c52f1fbd-ea33-468e-9695-826a7eb36aa6 response_code = 200 uri = /network-bootstore-config
30962024-11-28T05:05:25.033ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30972024-11-28T05:05:25.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92624 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63223 req_id = 06d495c9-89ef-447e-a8aa-d277de177ad1 response_code = 204 uri = /switch-ports
30982024-11-28T05:05:25.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63223 req_id = 83ba96f6-825b-4c54-a057-fc6b9a147462 response_code = 200 uri = /network-bootstore-config
30992024-11-28T05:05:36.520ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8693 local_addr = [fd00:1122:3344:101::1]:57603 method = GET remote_addr = [fd00:1122:3344:101::d]:36983 req_id = daa5e4f9-c6fe-4361-aaaf-c6725c072d49 response_code = 200 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 uri = /e95a4636-3865-437f-b2db-2549d48485b1
31002024-11-28T05:05:41.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65485
31012024-11-28T05:05:41.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 678 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65485 req_id = 42ffcbab-518f-4ac3-ad76-72eaeaccff01 response_code = 200 uri = /vmms/1a3a5c8e-d886-4582-8e81-6d293b7bc4b9/state
31022024-11-28T05:05:41.082ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-28T05:05:41.082419094Z } file = sled-agent/src/instance.rs:780 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31032024-11-28T05:05:41.082ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-28T05:05:41.082419094Z } propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31042024-11-28T05:05:41.082ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-28T05:05:41.082419094Z }, migration_in: None, migration_out: None }
31052024-11-28T05:05:41.131ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-28T05:05:41.131889412Z } file = sled-agent/src/instance.rs:780 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31062024-11-28T05:05:41.131ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-28T05:05:41.131889412Z } propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31072024-11-28T05:05:41.131ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31082024-11-28T05:05:41.131ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31092024-11-28T05:05:41.132ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 12383090802011370442 n_samples = 6 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
31102024-11-28T05:05:41.132ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31112024-11-28T05:05:41.132ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/4804908f-0424-4e53-a3b8-3a78658ad743/debug/bundle/zone", "/pool/int/56650285-0e45-49ec-ab47-9b356ce5dd77/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/4f498487-c0df-4538-adab-e17b7773b517/crypt/debug", "/pool/ext/3abe6613-feef-46d1-ade9-21289cb9be78/crypt/debug", "/pool/ext/cae3a0c5-81cb-482f-9ae7-1619fb0561c9/crypt/debug", "/pool/ext/4580e895-8d6e-45b1-823b-3db8fe32cccf/crypt/debug", "/pool/ext/c1ab70e5-120b-4db1-895c-564a6858dda1/crypt/debug", "/pool/ext/46c9f34c-d4c5-49e7-81c2-324226caf2cc/crypt/debug", "/pool/ext/6d0dec14-4f9a-4b89-a3ba-43f301b5efad/crypt/debug", "/pool/ext/655b21d3-4cba-44ac-b0bc-c895494baa1b/crypt/debug", "/pool/ext/33949fdd-4265-4f10-ab58-a876a4529485/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31122024-11-28T05:05:41.132ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 8310700813075301361 n_samples = 6 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
31132024-11-28T05:05:41.191ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51822
31142024-11-28T05:05:41.191ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51822 req_id = d29f79a5-2285-4239-89ca-92b9c4d6ef49 response_code = 200 uri = /baseboard
31152024-11-28T05:05:41.784ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9", bundle_id: 9aa10d84-60ca-47e0-b31c-b2834fc6e4e6 }, time_created: 2024-11-28T05:05:41.132752141Z, version: 0, cause: TerminatedInstance }
31162024-11-28T05:05:41.784ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 file = sled-agent/src/instance.rs:1032 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31172024-11-28T05:05:43.577ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31182024-11-28T05:05:43.593ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(12693533), kind: System }
31192024-11-28T05:05:43.594ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(12693533), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31202024-11-28T05:05:43.594ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-28T05:05:43.594382595Z }, migration_in: None, migration_out: None }
31212024-11-28T05:05:43.644ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-28T05:05:43.594382595Z }, migration_in: None, migration_out: None }
31222024-11-28T05:05:43.649ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = a6e99c48-6d2d-46b8-a41f-1dcd46f5fe54 propolis_id = 1a3a5c8e-d886-4582-8e81-6d293b7bc4b9
31232024-11-28T05:05:44.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42088
31242024-11-28T05:05:44.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42088 req_id = da667333-bfc2-4788-a6b6-9c3b38d0e44a response_code = 200 uri = /vpc-routes
31252024-11-28T05:05:44.105ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {19a18ebd-21b0-4cd9-97c8-a78e84497af6: {10.151.2.175: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}, 10.151.2.176: {cb1f40d5-5a49-4e2c-9a31-a9bbcbc48865}}} }
31262024-11-28T05:05:44.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42088 req_id = 055fc105-d834-4309-a595-9421a87edd73 response_code = 204 uri = /eip-gateways
31272024-11-28T05:05:44.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42088 req_id = 339b6628-b600-46c1-a5c7-ed301dd7c6e5 response_code = 204 uri = /vpc-routes
31282024-11-28T05:05:44.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53732
31292024-11-28T05:05:44.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53732 req_id = c46a23fe-2868-4b7c-9897-d3273338ee68 response_code = 200 uri = /v2p
31302024-11-28T05:05:44.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42379
31312024-11-28T05:05:44.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42379 req_id = df2ac170-8693-4b14-a458-6c4c09d3215d response_code = 200 uri = /v2p
31322024-11-28T05:05:44.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45425
31332024-11-28T05:05:44.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45425 req_id = d90b4317-522e-41ee-9ef0-7cab8aed5cba response_code = 200 uri = /vpc-routes
31342024-11-28T05:05:44.532ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
31352024-11-28T05:05:44.532ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = e95a4636-3865-437f-b2db-2549d48485b1
31362024-11-28T05:05:44.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45425 req_id = 3326b646-a9b5-41f4-a177-365ec2bf1178 response_code = 204 uri = /eip-gateways
31372024-11-28T05:05:44.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45425 req_id = 13e92d9a-8009-42d9-83db-7f37dab1a790 response_code = 204 uri = /vpc-routes
31382024-11-28T05:05:45.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60239
31392024-11-28T05:05:45.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60239 req_id = 2e3128d1-019c-478e-ac41-ffae50cf0e56 response_code = 200 uri = /vpc-routes
31402024-11-28T05:05:45.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e95a4636-3865-437f-b2db-2549d48485b1 values = ExternalIpGatewayMap { mappings: {} }
31412024-11-28T05:05:45.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60239 req_id = 3b34ff9f-7f7e-4140-b8ee-d8eb0333e3cf response_code = 204 uri = /eip-gateways
31422024-11-28T05:05:45.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60239 req_id = 0078d4ad-ec11-40a9-a4b6-cb96055564cd response_code = 204 uri = /vpc-routes