Max level shown:
12024-05-16T19:46:20.491ZINFOphd-runner: phd_runner file = phd-tests/runner/src/main.rs line = 35 runner_args = ProcessArgs { command: Run(RunOptions { propolis_server_cmd: "/work/phd-test/propolis-server", base_propolis_branch: Some("master"), base_propolis_commit: None, base_propolis_cmd: None, crucible_downstairs_cmd: None, crucible_downstairs_commit: Some(Auto), tmp_directory: "/tmp/propolis-phd", artifact_directory: Some("/phd-artifacts"), server_logging_mode: TmpFile, default_guest_cpus: 2, default_guest_memory_mib: 512, artifact_toml_path: "/work/phd-test/artifacts.toml", default_guest_artifact: "alpine", default_bootrom_artifact: "ovmf", include_filter: [], exclude_filter: [], max_buildomat_wait_secs: 1200 }), disable_ansi: false, emit_bunyan: true } target = phd_runner
22024-05-16T19:46:20.493ZDEBGphd-runner: Created new artifact store from manifest file = phd-tests/framework/src/artifacts/store.rs line = 221 store = Store { local_dir: "/phd-artifacts", artifacts: {"alpine": Mutex { data: StoredArtifact { description: Artifact { filename: "alpine.iso", kind: GuestOs(Alpine), source: RemoteServer { sha256: "ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1" }, untar: None }, cached_path: None } }, "ovmf": Mutex { data: StoredArtifact { description: Artifact { filename: "OVMF_CODE.fd", kind: Bootrom, source: Buildomat(BuildomatArtifact { repo: Repo("oxidecomputer/edk2"), series: Series("image_debug"), commit: Commit("6d92acf0a22718dd4175d7c64dbcf7aaec3740bd"), sha256: "29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f" }), untar: None }, cached_path: None } }}, downloader: DownloadConfig { timeout: 600s, buildomat_backoff: ExponentialBackoff { current_interval: 1s, initial_interval: 1s, randomization_factor: 0.5, multiplier: 1.5, max_interval: 60s, start_time: Instant { tv_sec: 612, tv_nsec: 73278001 }, max_elapsed_time: Some(1200s), clock: SystemClock }, remote_server_uris: ["https://oxide-omicron-build.s3.amazonaws.com"] } } target = phd_framework::artifacts::store
32024-05-16T19:46:20.493ZINFOphd-runner: Adding Propolis server from local command file = phd-tests/framework/src/artifacts/store.rs line = 229 propolis_server_cmd = /work/phd-test/propolis-server target = phd_framework::artifacts::store
42024-05-16T19:46:20.493ZINFOphd-runner: Adding crucible-downstairs from Buildomat Git revision commit = 62cc2cfe64ca09c6876be7633355026fa65c8545 file = phd-tests/framework/src/artifacts/store.rs line = 313 target = phd_framework::artifacts::store
52024-05-16T19:46:20.494ZDEBGphd-runner: Downloading file from Buildomat... file = phd-tests/framework/src/artifacts/buildomat.rs line = 215 target = phd_framework::artifacts::buildomat timeout = 600s uri = https://buildomat.eng.oxide.computer/public/file/oxidecomputer/crucible/nightly-image/62cc2cfe64ca09c6876be7633355026fa65c8545/crucible-nightly.sha256.txt
62024-05-16T19:46:20.737ZINFOphd-runner: Adding 'current' Propolis server from Buildomat Git branch 'master' file = phd-tests/framework/src/artifacts/store.rs line = 250 target = phd_framework::artifacts::store
72024-05-16T19:46:21.114ZDEBGphd-runner: Downloading file from Buildomat... file = phd-tests/framework/src/artifacts/buildomat.rs line = 215 target = phd_framework::artifacts::buildomat timeout = 600s uri = https://buildomat.eng.oxide.computer/public/file/oxidecomputer/propolis/phd_build/868cc546b53c862ec0180f2f0896041df51f953b/propolis-server.sha256.txt
82024-05-16T19:46:21.229ZINFOphd-runner: [EXECUTION_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 25 target = phd_runner::fixtures
92024-05-16T19:46:21.229ZINFOphd-runner: [EXECUTION_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 25 target = phd_runner::fixtures
102024-05-16T19:46:21.230ZINFOphd-runner: Running 22 test(s) file = phd-tests/runner/src/execute.rs line = 82 target = phd_runner::execute
112024-05-16T19:46:21.230ZINFOphd-runner: Starting test phd_tests::crucible::smoke::shutdown_persistence_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
122024-05-16T19:46:21.230ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
132024-05-16T19:46:21.230ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
142024-05-16T19:46:21.230ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/smoke.rs line = 19 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_tests::crucible::smoke
152024-05-16T19:46:21.230ZDEBGphd-runner: [TEST - EVENT] checking for existing copy of artifact file = phd-tests/framework/src/artifacts/store.rs line = 89 maybe_path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store
162024-05-16T19:46:21.230ZDEBGphd-runner: [TEST - EVENT] Downloading file from Buildomat... file = phd-tests/framework/src/artifacts/buildomat.rs line = 215 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::buildomat timeout = 600s uri = https://buildomat.eng.oxide.computer/public/file/oxidecomputer/edk2/image_debug/6d92acf0a22718dd4175d7c64dbcf7aaec3740bd/OVMF_CODE.fd
172024-05-16T19:46:22.817ZDEBGphd-runner: [TEST - EVENT] checking for existing copy of artifact file = phd-tests/framework/src/artifacts/store.rs line = 89 maybe_path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store
182024-05-16T19:46:22.817ZDEBGphd-runner: [TEST - EVENT] Downloading alpine.iso from https://oxide-omicron-build.s3.amazonaws.com/alpine.iso file = phd-tests/framework/src/artifacts/store.rs line = 618 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store timeout = 600s
192024-05-16T19:46:52.071ZDEBGphd-runner: [TEST - EVENT] checking for existing copy of artifact file = phd-tests/framework/src/artifacts/store.rs line = 89 maybe_path = /phd-artifacts/92ca9a205b0cbde1d1892db2b6cb7ff84eef850f31be5d4c9f1b6960ddbb1949/crucible-nightly.tar.gz path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store
202024-05-16T19:46:52.071ZDEBGphd-runner: [TEST - EVENT] Downloading file from Buildomat... file = phd-tests/framework/src/artifacts/buildomat.rs line = 215 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::buildomat timeout = 600s uri = https://buildomat.eng.oxide.computer/public/file/oxidecomputer/crucible/nightly-image/62cc2cfe64ca09c6876be7633355026fa65c8545/crucible-nightly.tar.gz
212024-05-16T19:47:24.627ZDEBGphd-runner: [TEST - EVENT] Extracting artifact from tarball extracted_path = /phd-artifacts/92ca9a205b0cbde1d1892db2b6cb7ff84eef850f31be5d4c9f1b6960ddbb1949/crucible-downstairs file = phd-tests/framework/src/artifacts/store.rs line = 162 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store untar_path = target/release/crucible-downstairs
222024-05-16T19:47:24.627ZDEBGphd-runner: [TEST - EVENT] Extracting gzipped tarball... file = phd-tests/framework/src/artifacts/store.rs line = 518 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store
232024-05-16T19:47:30.763ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
242024-05-16T19:47:30.763ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9000", "--encrypted", "--uuid", "fa13d777-3264-4d20-8f2d-50f8e92ee026", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
252024-05-16T19:47:30.829ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::shutdown_persistence_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.792428053Z","hostname":"sock","pid":859}\n{"msg":"UUID: fa13d777-3264-4d20-8f2d-50f8e92ee026","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.823494547Z","hostname":"sock","pid":859}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.823505588Z","hostname":"sock","pid":859}\n target = phd_framework::disk::crucible
262024-05-16T19:47:30.829ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9001", "--encrypted", "--uuid", "fa13d777-3264-4d20-8f2d-50f8e92ee026", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
272024-05-16T19:47:30.884ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::shutdown_persistence_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.845917849Z","hostname":"sock","pid":860}\n{"msg":"UUID: fa13d777-3264-4d20-8f2d-50f8e92ee026","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.877928626Z","hostname":"sock","pid":860}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.877946036Z","hostname":"sock","pid":860}\n target = phd_framework::disk::crucible
282024-05-16T19:47:30.884ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9002", "--encrypted", "--uuid", "fa13d777-3264-4d20-8f2d-50f8e92ee026", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
292024-05-16T19:47:30.934ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::shutdown_persistence_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.898207014Z","hostname":"sock","pid":861}\n{"msg":"UUID: fa13d777-3264-4d20-8f2d-50f8e92ee026","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.928202243Z","hostname":"sock","pid":861}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:30.928211223Z","hostname":"sock","pid":861}\n target = phd_framework::disk::crucible
302024-05-16T19:47:30.934ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::shutdown_persistence_test stderr_path = "/tmp/propolis-phd/crucible_fa13d777-3264-4d20-8f2d-50f8e92ee026_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_fa13d777-3264-4d20-8f2d-50f8e92ee026_9000.stdout.log" target = phd_framework::server_log_mode
312024-05-16T19:47:30.934ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
322024-05-16T19:47:30.934ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
332024-05-16T19:47:30.941ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::shutdown_persistence_test stderr_path = "/tmp/propolis-phd/crucible_fa13d777-3264-4d20-8f2d-50f8e92ee026_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_fa13d777-3264-4d20-8f2d-50f8e92ee026_9001.stdout.log" target = phd_framework::server_log_mode
342024-05-16T19:47:30.941ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
352024-05-16T19:47:30.941ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
362024-05-16T19:47:30.947ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::shutdown_persistence_test stderr_path = "/tmp/propolis-phd/crucible_fa13d777-3264-4d20-8f2d-50f8e92ee026_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_fa13d777-3264-4d20-8f2d-50f8e92ee026_9002.stdout.log" target = phd_framework::server_log_mode
372024-05-16T19:47:30.947ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
382024-05-16T19:47:30.947ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
392024-05-16T19:47:30.953ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::test_vm
402024-05-16T19:47:30.953ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::crucible::smoke::shutdown_persistence_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"fa13d777-3264-4d20-8f2d-50f8e92ee026\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"afb70646-728a-4a93-9749-712584592330\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"fdadbad7-522e-4444-bcd9-4d394b50b863\\",\\"key\\":\\"yC+fvnMS6DsjxBII06U4jzbNA66SAUggKae6f64ORjM=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = crucible_shutdown_persistence_test
412024-05-16T19:47:30.953ZDEBGphd-runner: [NEW - EVENT] Examining locally-sourced artifact file = phd-tests/framework/src/artifacts/store.rs line = 56 path = /work/phd-test/propolis-server sha256 = None target = phd_framework::artifacts::store
422024-05-16T19:47:30.953ZDEBGphd-runner: [NEW - EVENT] Locally-sourced artifact is valid, caching its path file = phd-tests/framework/src/artifacts/store.rs line = 69 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
432024-05-16T19:47:30.953ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_shutdown_persistence_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::smoke::shutdown_persistence_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
442024-05-16T19:47:30.953ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::shutdown_persistence_test stderr_path = "/tmp/propolis-phd/crucible_shutdown_persistence_test.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_shutdown_persistence_test.stdout.log" target = phd_framework::server_log_mode
452024-05-16T19:47:30.960ZINFOphd-runner: [NEW - EVENT] Launched server with pid 865 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::test_vm::server
462024-05-16T19:47:30.960ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 7 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::test_vm
472024-05-16T19:47:30.961ZDEBGphd-runner: [TEST - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::smoke::shutdown_persistence_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server
482024-05-16T19:47:30.974ZINFOphd-runner: [TEST - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::shutdown_persistence_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9000" } } target = phd_framework::disk::crucible
492024-05-16T19:47:30.980ZINFOphd-runner: [TEST - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::shutdown_persistence_test self.path = "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9000" target = phd_framework::disk::crucible
502024-05-16T19:47:30.987ZINFOphd-runner: [TEST - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::shutdown_persistence_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9001" } } target = phd_framework::disk::crucible
512024-05-16T19:47:30.993ZINFOphd-runner: [TEST - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::shutdown_persistence_test self.path = "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9001" target = phd_framework::disk::crucible
522024-05-16T19:47:31.000ZINFOphd-runner: [TEST - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::shutdown_persistence_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9002" } } target = phd_framework::disk::crucible
532024-05-16T19:47:31.007ZINFOphd-runner: [TEST - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::shutdown_persistence_test self.path = "/tmp/propolis-phd/fa13d777-3264-4d20-8f2d-50f8e92ee026_9002" target = phd_framework::disk::crucible
542024-05-16T19:47:31.014ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 69784 file = phd-tests/tests/src/crucible/smoke.rs line = 19 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_tests::crucible::smoke
552024-05-16T19:47:31.014ZINFOphd-runner: test phd_tests::crucible::smoke::shutdown_persistence_test ... skipped: Can't run data persistence test on a guest with a read-only file system file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
562024-05-16T19:47:31.015ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
572024-05-16T19:47:31.015ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
582024-05-16T19:47:31.015ZINFOphd-runner: Starting test phd_tests::crucible::smoke::boot_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
592024-05-16T19:47:31.015ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
602024-05-16T19:47:31.015ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
612024-05-16T19:47:31.015ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/smoke.rs line = 10 path = phd_tests::crucible::smoke::boot_test target = phd_tests::crucible::smoke
622024-05-16T19:47:31.015ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
632024-05-16T19:47:31.015ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
642024-05-16T19:47:31.015ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/92ca9a205b0cbde1d1892db2b6cb7ff84eef850f31be5d4c9f1b6960ddbb1949/crucible-downstairs target = phd_framework::artifacts::store
652024-05-16T19:47:31.015ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
662024-05-16T19:47:31.016ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9000", "--encrypted", "--uuid", "a59eedd8-1900-415f-8e2a-2c43c8a97295", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
672024-05-16T19:47:31.072ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::boot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.03121658Z","hostname":"sock","pid":867}\n{"msg":"UUID: a59eedd8-1900-415f-8e2a-2c43c8a97295","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.065459353Z","hostname":"sock","pid":867}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.065474283Z","hostname":"sock","pid":867}\n target = phd_framework::disk::crucible
682024-05-16T19:47:31.073ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9001", "--encrypted", "--uuid", "a59eedd8-1900-415f-8e2a-2c43c8a97295", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
692024-05-16T19:47:31.128ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::boot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.088124042Z","hostname":"sock","pid":868}\n{"msg":"UUID: a59eedd8-1900-415f-8e2a-2c43c8a97295","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.120703978Z","hostname":"sock","pid":868}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.120717949Z","hostname":"sock","pid":868}\n target = phd_framework::disk::crucible
702024-05-16T19:47:31.128ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9002", "--encrypted", "--uuid", "a59eedd8-1900-415f-8e2a-2c43c8a97295", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
712024-05-16T19:47:31.183ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::boot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.143222053Z","hostname":"sock","pid":869}\n{"msg":"UUID: a59eedd8-1900-415f-8e2a-2c43c8a97295","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.17642635Z","hostname":"sock","pid":869}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:47:31.176439481Z","hostname":"sock","pid":869}\n target = phd_framework::disk::crucible
722024-05-16T19:47:31.183ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::boot_test stderr_path = "/tmp/propolis-phd/crucible_a59eedd8-1900-415f-8e2a-2c43c8a97295_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_a59eedd8-1900-415f-8e2a-2c43c8a97295_9000.stdout.log" target = phd_framework::server_log_mode
732024-05-16T19:47:31.183ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
742024-05-16T19:47:31.183ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
752024-05-16T19:47:31.192ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::boot_test stderr_path = "/tmp/propolis-phd/crucible_a59eedd8-1900-415f-8e2a-2c43c8a97295_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_a59eedd8-1900-415f-8e2a-2c43c8a97295_9001.stdout.log" target = phd_framework::server_log_mode
762024-05-16T19:47:31.192ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
772024-05-16T19:47:31.192ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
782024-05-16T19:47:31.200ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::boot_test stderr_path = "/tmp/propolis-phd/crucible_a59eedd8-1900-415f-8e2a-2c43c8a97295_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_a59eedd8-1900-415f-8e2a-2c43c8a97295_9002.stdout.log" target = phd_framework::server_log_mode
792024-05-16T19:47:31.200ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
802024-05-16T19:47:31.200ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
812024-05-16T19:47:31.208ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
822024-05-16T19:47:31.208ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::crucible::smoke::boot_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"a59eedd8-1900-415f-8e2a-2c43c8a97295\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"16af6db1-799c-436e-8d6d-0350b6807c55\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"935a58be-284e-43d6-92f2-46351a426c90\\",\\"key\\":\\"2/Bi0GMAeH1kQvuUCyhfYGHfeRM3V/WLbKrG97Y7xBs=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = crucible_boot_test
832024-05-16T19:47:31.208ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
842024-05-16T19:47:31.208ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_boot_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::smoke::boot_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
852024-05-16T19:47:31.208ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::boot_test stderr_path = "/tmp/propolis-phd/crucible_boot_test.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_boot_test.stdout.log" target = phd_framework::server_log_mode
862024-05-16T19:47:31.215ZINFOphd-runner: [NEW - EVENT] Launched server with pid 873 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm::server
872024-05-16T19:47:31.215ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 7 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
882024-05-16T19:47:31.215ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
892024-05-16T19:47:31.216ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
902024-05-16T19:47:31.699ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
912024-05-16T19:47:31.700ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: f2ae1af0-cd01-434d-8e97-d4b294bc9b10, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 1ddd0a49-3554-4005-b7c2-251c526e4012, silo_id: 03729ee1-cc4b-484c-a3a0-0302496ad347 }, name: "phd-vm-f2ae1af0-cd01-434d-8e97-d4b294bc9b10", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::crucible::smoke::boot_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"a59eedd8-1900-415f-8e2a-2c43c8a97295\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"16af6db1-799c-436e-8d6d-0350b6807c55\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"935a58be-284e-43d6-92f2-46351a426c90\\",\\"key\\":\\"2/Bi0GMAeH1kQvuUCyhfYGHfeRM3V/WLbKrG97Y7xBs=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
922024-05-16T19:47:31.700ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 484 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
932024-05-16T19:47:31.700ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
942024-05-16T19:47:31.700ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::boot_test state = Run target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
952024-05-16T19:47:31.701ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
962024-05-16T19:47:31.701ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
972024-05-16T19:47:31.701ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
982024-05-16T19:47:31.702ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::smoke::boot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
992024-05-16T19:47:31.702ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1002024-05-16T19:47:31.702ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1012024-05-16T19:47:36.540ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4838 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1022024-05-16T19:47:36.540ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::smoke::boot_test step = WriteStr("root") target = phd_framework::test_vm
1032024-05-16T19:47:36.541ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::smoke::boot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
1042024-05-16T19:47:36.541ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1052024-05-16T19:47:36.541ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1062024-05-16T19:47:36.561ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1072024-05-16T19:47:36.561ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
1082024-05-16T19:47:36.561ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4859 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
1092024-05-16T19:47:36.561ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1102024-05-16T19:47:36.561ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
1112024-05-16T19:47:36.562ZINFOphd-runner: test phd_tests::crucible::smoke::boot_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
1122024-05-16T19:47:36.562ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4862 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
1132024-05-16T19:47:36.562ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
1142024-05-16T19:47:36.563ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1152024-05-16T19:47:36.839ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::smoke::boot_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1162024-05-16T19:47:36.965ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::boot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9000" } } target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1172024-05-16T19:47:36.974ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::boot_test self.path = "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9000" target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1182024-05-16T19:47:36.984ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::boot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9001" } } target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1192024-05-16T19:47:36.995ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::boot_test self.path = "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9001" target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1202024-05-16T19:47:37.006ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::boot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9002" } } target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1212024-05-16T19:47:37.017ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::boot_test self.path = "/tmp/propolis-phd/a59eedd8-1900-415f-8e2a-2c43c8a97295_9002" target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1222024-05-16T19:47:37.028ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 466 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = f2ae1af0-cd01-434d-8e97-d4b294bc9b10
1232024-05-16T19:47:37.028ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 6012 file = phd-tests/tests/src/crucible/smoke.rs line = 10 path = phd_tests::crucible::smoke::boot_test target = phd_tests::crucible::smoke
1242024-05-16T19:47:37.028ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 466 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
1252024-05-16T19:47:37.028ZINFOphd-runner: Starting test phd_tests::smoke::instance_spec_get_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
1262024-05-16T19:47:37.028ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
1272024-05-16T19:47:37.028ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
1282024-05-16T19:47:37.029ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/smoke.rs line = 18 path = phd_tests::smoke::instance_spec_get_test target = phd_tests::smoke
1292024-05-16T19:47:37.029ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
1302024-05-16T19:47:37.029ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
1312024-05-16T19:47:37.029ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
1322024-05-16T19:47:37.029ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = list
1332024-05-16T19:47:37.043ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::instance_spec_get_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 187M 1.80T 186M /phd-artifacts\n target = phd_framework::zfs
1342024-05-16T19:47:37.044ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-e134eb60-ff6c-42aa-b6ef-7a680f6cc94d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = snapshot
1352024-05-16T19:47:37.060ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-e134eb60-ff6c-42aa-b6ef-7a680f6cc94d", "phd-artifacts/phd-clone-5e07a172-47b0-4f8a-a51b-30f2523a8757"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = clone
1362024-05-16T19:47:37.079ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-5e07a172-47b0-4f8a-a51b-30f2523a8757"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = list
1372024-05-16T19:47:37.091ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::instance_spec_get_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-5e07a172-47b0-4f8a-a51b-30f2523a8757 0B 1.80T 186M /phd-artifacts/phd-clone-5e07a172-47b0-4f8a-a51b-30f2523a8757\n target = phd_framework::zfs
1382024-05-16T19:47:37.092ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm
1392024-05-16T19:47:37.092ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::smoke::instance_spec_get_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-5e07a172-47b0-4f8a-a51b-30f2523a8757/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 3072 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = instance_spec_test
1402024-05-16T19:47:37.092ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
1412024-05-16T19:47:37.092ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_spec_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::smoke::instance_spec_get_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
1422024-05-16T19:47:37.092ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::smoke::instance_spec_get_test stderr_path = "/tmp/propolis-phd/instance_spec_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_spec_test.stdout.log" target = phd_framework::server_log_mode
1432024-05-16T19:47:37.098ZINFOphd-runner: [NEW - EVENT] Launched server with pid 879 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm::server
1442024-05-16T19:47:37.098ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 6 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm
1452024-05-16T19:47:37.098ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1462024-05-16T19:47:37.099ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1472024-05-16T19:47:38.216ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
1482024-05-16T19:47:38.216ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: c83fa3b1-3d1e-4032-989f-8352a0f43bee, image_id: 00000000-0000-0000-0000-000000000000, memory: 3072, metadata: InstanceMetadata { project_id: d017b960-b157-40d0-8b8b-042aa6947812, silo_id: d3880610-1ab6-47f5-9403-9b35140099e6 }, name: "phd-vm-c83fa3b1-3d1e-4032-989f-8352a0f43bee", vcpus: 4 }, state: Creating } line = 381 path = phd_tests::smoke::instance_spec_get_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-5e07a172-47b0-4f8a-a51b-30f2523a8757/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 3072 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1492024-05-16T19:47:38.216ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 1118 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1502024-05-16T19:47:38.216ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1512024-05-16T19:47:38.216ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::instance_spec_get_test state = Run target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1522024-05-16T19:47:38.217ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1532024-05-16T19:47:38.217ZINFOphd-runner: [GET_SPEC - START] file = phd-tests/framework/src/test_vm/mod.rs line = 458 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1542024-05-16T19:47:38.217ZINFOphd-runner: [GET_SPEC - EVENT] Sending instance spec get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 460 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1552024-05-16T19:47:38.218ZINFOphd-runner: [GET_SPEC - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 458 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1562024-05-16T19:47:38.218ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1572024-05-16T19:47:38.218ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
1582024-05-16T19:47:38.218ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 2 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
1592024-05-16T19:47:38.218ZINFOphd-runner: test phd_tests::smoke::instance_spec_get_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
1602024-05-16T19:47:38.218ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
1612024-05-16T19:47:38.219ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1622024-05-16T19:47:38.857ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::smoke::instance_spec_get_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1632024-05-16T19:47:39.431ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1642024-05-16T19:47:39.431ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-5e07a172-47b0-4f8a-a51b-30f2523a8757"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = destroy vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1652024-05-16T19:47:39.462ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1662024-05-16T19:47:39.462ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-e134eb60-ff6c-42aa-b6ef-7a680f6cc94d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = destroy vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1672024-05-16T19:47:39.479ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 1261 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c83fa3b1-3d1e-4032-989f-8352a0f43bee
1682024-05-16T19:47:39.479ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 2450 file = phd-tests/tests/src/smoke.rs line = 18 path = phd_tests::smoke::instance_spec_get_test target = phd_tests::smoke
1692024-05-16T19:47:39.480ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 1261 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
1702024-05-16T19:47:39.480ZINFOphd-runner: Starting test phd_tests::smoke::nproc_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
1712024-05-16T19:47:39.480ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
1722024-05-16T19:47:39.480ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
1732024-05-16T19:47:39.480ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/smoke.rs line = 7 path = phd_tests::smoke::nproc_test target = phd_tests::smoke
1742024-05-16T19:47:39.480ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
1752024-05-16T19:47:39.480ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
1762024-05-16T19:47:39.480ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
1772024-05-16T19:47:39.480ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = list
1782024-05-16T19:47:39.495ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::nproc_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 187M 1.80T 186M /phd-artifacts\n target = phd_framework::zfs
1792024-05-16T19:47:39.495ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-0a7a12fc-9e91-435e-bfca-84bff39e081d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = snapshot
1802024-05-16T19:47:39.513ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-0a7a12fc-9e91-435e-bfca-84bff39e081d", "phd-artifacts/phd-clone-9b809230-9611-4726-b172-f6f9b8695103"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = clone
1812024-05-16T19:47:39.530ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-9b809230-9611-4726-b172-f6f9b8695103"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = list
1822024-05-16T19:47:39.542ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::nproc_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-9b809230-9611-4726-b172-f6f9b8695103 0B 1.80T 186M /phd-artifacts/phd-clone-9b809230-9611-4726-b172-f6f9b8695103\n target = phd_framework::zfs
1832024-05-16T19:47:39.543ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
1842024-05-16T19:47:39.543ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::smoke::nproc_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9b809230-9611-4726-b172-f6f9b8695103/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 6, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = nproc_test
1852024-05-16T19:47:39.543ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
1862024-05-16T19:47:39.543ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/nproc_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::smoke::nproc_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
1872024-05-16T19:47:39.543ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::smoke::nproc_test stderr_path = "/tmp/propolis-phd/nproc_test.stderr.log" stdout_path = "/tmp/propolis-phd/nproc_test.stdout.log" target = phd_framework::server_log_mode
1882024-05-16T19:47:39.549ZINFOphd-runner: [NEW - EVENT] Launched server with pid 887 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm::server
1892024-05-16T19:47:39.549ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 6 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
1902024-05-16T19:47:39.550ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
1912024-05-16T19:47:39.550ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
1922024-05-16T19:47:40.316ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
1932024-05-16T19:47:40.317ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 9ac147ca-2eea-49a4-b70b-f9382f4749e6, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: e4c8ecb4-b7c0-4024-a6d4-11bb1606b4d0, silo_id: d8479cb5-a5ab-45ca-b4b8-0ca7cf7f9746 }, name: "phd-vm-9ac147ca-2eea-49a4-b70b-f9382f4749e6", vcpus: 6 }, state: Creating } line = 381 path = phd_tests::smoke::nproc_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9b809230-9611-4726-b172-f6f9b8695103/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 6, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
1942024-05-16T19:47:40.317ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 767 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
1952024-05-16T19:47:40.317ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
1962024-05-16T19:47:40.317ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::nproc_test state = Run target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
1972024-05-16T19:47:40.318ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
1982024-05-16T19:47:40.318ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
1992024-05-16T19:47:40.318ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = 300s vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2002024-05-16T19:47:40.318ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::smoke::nproc_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
2012024-05-16T19:47:40.318ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2022024-05-16T19:47:40.318ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2032024-05-16T19:47:45.282ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4963 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2042024-05-16T19:47:45.282ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::smoke::nproc_test step = WriteStr("root") target = phd_framework::test_vm
2052024-05-16T19:47:45.282ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::smoke::nproc_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
2062024-05-16T19:47:45.282ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2072024-05-16T19:47:45.282ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2082024-05-16T19:47:45.303ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2092024-05-16T19:47:45.303ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
2102024-05-16T19:47:45.303ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4985 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
2112024-05-16T19:47:45.303ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2122024-05-16T19:47:45.303ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2132024-05-16T19:47:45.309ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2142024-05-16T19:47:45.309ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2152024-05-16T19:47:45.309ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2162024-05-16T19:47:45.342ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2172024-05-16T19:47:45.342ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2182024-05-16T19:47:45.342ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
2192024-05-16T19:47:45.342ZINFOphd-runner: test phd_tests::smoke::nproc_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
2202024-05-16T19:47:45.342ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 5026 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
2212024-05-16T19:47:45.342ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
2222024-05-16T19:47:45.343ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2232024-05-16T19:47:45.691ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::smoke::nproc_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2242024-05-16T19:47:45.817ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::smoke::nproc_test target = phd_framework::zfs vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2252024-05-16T19:47:45.817ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-9b809230-9611-4726-b172-f6f9b8695103"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = destroy vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2262024-05-16T19:47:45.845ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::smoke::nproc_test target = phd_framework::zfs vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2272024-05-16T19:47:45.845ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-0a7a12fc-9e91-435e-bfca-84bff39e081d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = destroy vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2282024-05-16T19:47:45.867ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 525 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 9ac147ca-2eea-49a4-b70b-f9382f4749e6
2292024-05-16T19:47:45.867ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 6387 file = phd-tests/tests/src/smoke.rs line = 7 path = phd_tests::smoke::nproc_test target = phd_tests::smoke
2302024-05-16T19:47:45.867ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 524 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
2312024-05-16T19:47:45.867ZINFOphd-runner: Starting test phd_tests::framework::multiline_serial_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
2322024-05-16T19:47:45.868ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
2332024-05-16T19:47:45.868ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
2342024-05-16T19:47:45.868ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/framework.rs line = 10 path = phd_tests::framework::multiline_serial_test target = phd_tests::framework
2352024-05-16T19:47:45.868ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
2362024-05-16T19:47:45.868ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
2372024-05-16T19:47:45.868ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
2382024-05-16T19:47:45.868ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = list
2392024-05-16T19:47:45.881ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::framework::multiline_serial_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 188M 1.80T 186M /phd-artifacts\n target = phd_framework::zfs
2402024-05-16T19:47:45.881ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-42380995-e587-4a2c-bac6-b3cee9c78c0e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = snapshot
2412024-05-16T19:47:45.897ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-42380995-e587-4a2c-bac6-b3cee9c78c0e", "phd-artifacts/phd-clone-31eae952-b25c-4d3e-89a7-b6dac7c20784"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = clone
2422024-05-16T19:47:45.915ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-31eae952-b25c-4d3e-89a7-b6dac7c20784"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = list
2432024-05-16T19:47:45.927ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::framework::multiline_serial_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-31eae952-b25c-4d3e-89a7-b6dac7c20784 0B 1.80T 186M /phd-artifacts/phd-clone-31eae952-b25c-4d3e-89a7-b6dac7c20784\n target = phd_framework::zfs
2442024-05-16T19:47:45.927ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
2452024-05-16T19:47:45.927ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::framework::multiline_serial_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-31eae952-b25c-4d3e-89a7-b6dac7c20784/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = multiline_test
2462024-05-16T19:47:45.928ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
2472024-05-16T19:47:45.928ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/multiline_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::framework::multiline_serial_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
2482024-05-16T19:47:45.928ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::framework::multiline_serial_test stderr_path = "/tmp/propolis-phd/multiline_test.stderr.log" stdout_path = "/tmp/propolis-phd/multiline_test.stdout.log" target = phd_framework::server_log_mode
2492024-05-16T19:47:45.933ZINFOphd-runner: [NEW - EVENT] Launched server with pid 895 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm::server
2502024-05-16T19:47:45.934ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 6 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
2512024-05-16T19:47:45.934ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2522024-05-16T19:47:45.934ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2532024-05-16T19:47:46.712ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
2542024-05-16T19:47:46.713ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: f38f7082-4093-4d2b-b29d-48c5ae13205a, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: b9d6f8e7-35ac-456d-a955-c1451a7cd67b, silo_id: d129cf5a-29e4-4b01-a740-c1934a53a9fc }, name: "phd-vm-f38f7082-4093-4d2b-b29d-48c5ae13205a", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::framework::multiline_serial_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-31eae952-b25c-4d3e-89a7-b6dac7c20784/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2552024-05-16T19:47:46.713ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 779 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2562024-05-16T19:47:46.713ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2572024-05-16T19:47:46.713ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::framework::multiline_serial_test state = Run target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2582024-05-16T19:47:46.714ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2592024-05-16T19:47:46.714ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
2602024-05-16T19:47:46.714ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = 300s vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2612024-05-16T19:47:46.714ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::framework::multiline_serial_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
2622024-05-16T19:47:46.714ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2632024-05-16T19:47:46.714ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2642024-05-16T19:47:50.917ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4202 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2652024-05-16T19:47:50.917ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::framework::multiline_serial_test step = WriteStr("root") target = phd_framework::test_vm
2662024-05-16T19:47:50.917ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::framework::multiline_serial_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
2672024-05-16T19:47:50.917ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2682024-05-16T19:47:50.917ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2692024-05-16T19:47:50.937ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2702024-05-16T19:47:50.937ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
2712024-05-16T19:47:50.937ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4223 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
2722024-05-16T19:47:50.938ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2732024-05-16T19:47:50.938ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2742024-05-16T19:47:50.966ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 28 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2752024-05-16T19:47:50.966ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2762024-05-16T19:47:50.966ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2772024-05-16T19:47:50.976ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2782024-05-16T19:47:50.977ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2792024-05-16T19:47:50.977ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
2802024-05-16T19:47:50.977ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4264 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
2812024-05-16T19:47:50.977ZINFOphd-runner: test phd_tests::framework::multiline_serial_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
2822024-05-16T19:47:50.977ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
2832024-05-16T19:47:50.978ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2842024-05-16T19:47:51.464ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::framework::multiline_serial_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2852024-05-16T19:47:51.589ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2862024-05-16T19:47:51.589ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-31eae952-b25c-4d3e-89a7-b6dac7c20784"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = destroy vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2872024-05-16T19:47:51.614ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2882024-05-16T19:47:51.614ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-42380995-e587-4a2c-bac6-b3cee9c78c0e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = destroy vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2892024-05-16T19:47:51.636ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 658 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = f38f7082-4093-4d2b-b29d-48c5ae13205a
2902024-05-16T19:47:51.636ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 5768 file = phd-tests/tests/src/framework.rs line = 10 path = phd_tests::framework::multiline_serial_test target = phd_tests::framework
2912024-05-16T19:47:51.636ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 659 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
2922024-05-16T19:47:51.636ZINFOphd-runner: Starting test phd_tests::migrate::from_base::migration_from_base_and_back file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
2932024-05-16T19:47:51.636ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
2942024-05-16T19:47:51.636ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
2952024-05-16T19:47:51.636ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 50 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_tests::migrate::from_base
2962024-05-16T19:47:51.636ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
2972024-05-16T19:47:51.637ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
2982024-05-16T19:47:51.637ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
2992024-05-16T19:47:51.637ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::zfs verb = list
3002024-05-16T19:47:51.649ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::from_base::migration_from_base_and_back stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 188M 1.80T 186M /phd-artifacts\n target = phd_framework::zfs
3012024-05-16T19:47:51.649ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-9c17d4df-7742-447e-a032-8c67cf8354ba"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::zfs verb = snapshot
3022024-05-16T19:47:51.668ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-9c17d4df-7742-447e-a032-8c67cf8354ba", "phd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::zfs verb = clone
3032024-05-16T19:47:51.687ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::zfs verb = list
3042024-05-16T19:47:51.699ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::from_base::migration_from_base_and_back stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb 0B 1.80T 186M /phd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb\n target = phd_framework::zfs
3052024-05-16T19:47:51.699ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm
3062024-05-16T19:47:51.699ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__BASE_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::from_base::migration_from_base_and_back spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_from_base_and_back
3072024-05-16T19:47:51.699ZDEBGphd-runner: [NEW - EVENT] checking for existing copy of artifact file = phd-tests/framework/src/artifacts/store.rs line = 89 maybe_path = /phd-artifacts/b58449462fa7fa216a1a261bdc5547beb5f611b5d9ec598f9126b3a7d4c7620d/propolis-server.tar.gz path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::artifacts::store
3082024-05-16T19:47:51.700ZDEBGphd-runner: [NEW - EVENT] Downloading file from Buildomat... file = phd-tests/framework/src/artifacts/buildomat.rs line = 215 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::artifacts::buildomat timeout = 600s uri = https://buildomat.eng.oxide.computer/public/file/oxidecomputer/propolis/phd_build/868cc546b53c862ec0180f2f0896041df51f953b/propolis-server.tar.gz
3092024-05-16T19:48:25.920ZDEBGphd-runner: [NEW - EVENT] Extracting artifact from tarball extracted_path = /phd-artifacts/b58449462fa7fa216a1a261bdc5547beb5f611b5d9ec598f9126b3a7d4c7620d/propolis-server file = phd-tests/framework/src/artifacts/store.rs line = 162 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::artifacts::store untar_path = propolis-server
3102024-05-16T19:48:25.920ZDEBGphd-runner: [NEW - EVENT] Extracting gzipped tarball... file = phd-tests/framework/src/artifacts/store.rs line = 518 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::artifacts::store
3112024-05-16T19:48:39.286ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_from_base_and_back.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::from_base::migration_from_base_and_back server_addr = 127.0.0.1:9000 server_path = "/phd-artifacts/b58449462fa7fa216a1a261bdc5547beb5f611b5d9ec598f9126b3a7d4c7620d/propolis-server" target = phd_framework::test_vm::server
3122024-05-16T19:48:39.286ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::from_base::migration_from_base_and_back stderr_path = "/tmp/propolis-phd/migration_from_base_and_back.stderr.log" stdout_path = "/tmp/propolis-phd/migration_from_base_and_back.stdout.log" target = phd_framework::server_log_mode
3132024-05-16T19:48:39.321ZINFOphd-runner: [NEW - EVENT] Launched server with pid 903 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm::server
3142024-05-16T19:48:39.322ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 47622 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm
3152024-05-16T19:48:39.322ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3162024-05-16T19:48:39.322ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3172024-05-16T19:48:40.089ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
3182024-05-16T19:48:40.090ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 7691511f-16f6-48f0-8f23-c3bf10a203b3, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 345c3124-d6c2-406d-954d-f364bb6db725, silo_id: edd2a26e-b83f-4b52-8df6-9110dab13632 }, name: "phd-vm-7691511f-16f6-48f0-8f23-c3bf10a203b3", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::from_base::migration_from_base_and_back self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3192024-05-16T19:48:40.090ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 768 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3202024-05-16T19:48:40.090ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3212024-05-16T19:48:40.090ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::from_base::migration_from_base_and_back state = Run target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3222024-05-16T19:48:40.091ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3232024-05-16T19:48:40.091ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm
3242024-05-16T19:48:40.091ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = 300s vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3252024-05-16T19:48:40.091ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::migration_from_base_and_back step = WaitFor("localhost login: ") target = phd_framework::test_vm
3262024-05-16T19:48:40.091ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3272024-05-16T19:48:40.091ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3282024-05-16T19:48:44.379ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4288 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3292024-05-16T19:48:44.380ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::migration_from_base_and_back step = WriteStr("root") target = phd_framework::test_vm
3302024-05-16T19:48:44.380ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::migration_from_base_and_back step = WaitFor("localhost:~#") target = phd_framework::test_vm
3312024-05-16T19:48:44.380ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3322024-05-16T19:48:44.380ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3332024-05-16T19:48:44.400ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3342024-05-16T19:48:44.400ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm
3352024-05-16T19:48:44.400ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4309 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm
3362024-05-16T19:48:44.401ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3372024-05-16T19:48:44.401ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3382024-05-16T19:48:44.407ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 6 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3392024-05-16T19:48:44.407ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3402024-05-16T19:48:44.407ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3412024-05-16T19:48:44.439ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 31 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3422024-05-16T19:48:44.439ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3432024-05-16T19:48:44.439ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3442024-05-16T19:48:44.449ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3452024-05-16T19:48:44.450ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3462024-05-16T19:48:44.450ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3472024-05-16T19:48:44.472ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3482024-05-16T19:48:44.472ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3492024-05-16T19:48:44.472ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3502024-05-16T19:48:44.482ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3512024-05-16T19:48:44.483ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3522024-05-16T19:48:44.483ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3532024-05-16T19:48:44.504ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3542024-05-16T19:48:44.504ZINFOphd-runner: [TEST - EVENT] migrating to new Propolis artifact for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 74 path = phd_tests::migrate::from_base::migration_from_base_and_back propolis_artifact = __DEFAULT_PROPOLIS target = phd_framework::lifecycle vm_name = migration_from_base_and_back
3552024-05-16T19:48:44.504ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm
3562024-05-16T19:48:44.504ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::from_base::migration_from_base_and_back spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_from_base_and_back_lifecycle_0
3572024-05-16T19:48:44.504ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
3582024-05-16T19:48:44.505ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::from_base::migration_from_base_and_back server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
3592024-05-16T19:48:44.505ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::from_base::migration_from_base_and_back stderr_path = "/tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
3602024-05-16T19:48:44.521ZINFOphd-runner: [NEW - EVENT] Launched server with pid 904 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm::server
3612024-05-16T19:48:44.522ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 17 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm
3622024-05-16T19:48:44.522ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3632024-05-16T19:48:44.522ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 2fa1741b-5670-41ca-92fe-c4c904f481d0 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064 timeout_duration = 45s
3642024-05-16T19:48:44.522ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064 vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3652024-05-16T19:48:44.523ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064 vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3662024-05-16T19:48:45.292ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: b4936a53-db62-4a1d-9a53-90d528e9e064, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 645e3a42-bf79-4a2b-bc3b-fcce765f89c3, silo_id: 7cdfa3f9-3a4e-4ed6-929c-dadad77d43d6 }, name: "phd-vm-b4936a53-db62-4a1d-9a53-90d528e9e064", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::from_base::migration_from_base_and_back self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064 vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3672024-05-16T19:48:45.292ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 769 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064 vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3682024-05-16T19:48:45.292ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 2fa1741b-5670-41ca-92fe-c4c904f481d0 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3692024-05-16T19:48:50.018ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 537 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3702024-05-16T19:48:50.018ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4726 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 2fa1741b-5670-41ca-92fe-c4c904f481d0 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3712024-05-16T19:48:50.018ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 5496 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::from_base::migration_from_base_and_back source = migration_from_base_and_back source_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3 target = phd_framework::test_vm target_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3722024-05-16T19:48:50.018ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3732024-05-16T19:48:50.019ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3742024-05-16T19:48:50.019ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3752024-05-16T19:48:50.020ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3762024-05-16T19:48:51.168ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
3772024-05-16T19:48:51.168ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 11078 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
3782024-05-16T19:48:51.168ZINFOphd-runner: test phd_tests::migrate::from_base::migration_from_base_and_back ... FAILED: live migration Caused by: error during migration Stack backtrace: 0: anyhow::__private::format_err at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.75/src/lib.rs:675:13 1: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:538:59 2: <backoff::future::Retry<S,B,N,Fn,Fut> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/backoff-0.4.0/src/future.rs:182:26 3: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:555:18 4: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.37/src/instrument.rs:272:9 5: phd_framework::test_vm::TestVm::migrate_from::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:471:5 6: phd_framework::lifecycle::<impl phd_framework::Framework>::lifecycle_test::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/lifecycle.rs:95:26 7: phd_tests::migrate::from_base::migration_from_base_and_back::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:81:10 8: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.37/src/instrument.rs:272:9 9: phd_tests::migrate::from_base::migration_from_base_and_back::{{closure}} at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:50:5 10: <core::pin::Pin<P> as core::future::future::Future>::poll at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/future/future.rs:123:9 11: phd_testcase::TestCase::run::{{closure}} at ./oxidecomputer/propolis/phd-tests/testcase/src/lib.rs:79:32 12: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/macros/select.rs:524:49 13: <tokio::future::poll_fn::PollFn<F> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/future/poll_fn.rs:58:9 14: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/runner/src/execute.rs:105:13 15: tokio::runtime::task::core::Core<T,S>::poll::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:328:17 16: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/loom/std/unsafe_cell.rs:16:9 tokio::runtime::task::core::Core<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:317:13 17: tokio::runtime::task::harness::poll_future::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:485:19 18: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 19: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 20: __rust_try 21: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 22: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 23: tokio::runtime::task::harness::poll_future at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:473:18 24: tokio::runtime::task::harness::Harness<T,S>::poll_inner at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:208:27 25: tokio::runtime::task::harness::Harness<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:153:15 26: tokio::runtime::task::raw::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:271:5 27: tokio::runtime::task::raw::RawTask::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:201:18 28: tokio::runtime::task::LocalNotified<S>::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/mod.rs:427:9 29: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:639:17 30: tokio::runtime::coop::with_budget at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:107:5 tokio::runtime::coop::budget at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:73:5 tokio::runtime::scheduler::multi_thread::worker::Context::run_task at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:575:9 31: tokio::runtime::scheduler::multi_thread::worker::Context::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:526:24 32: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:491:21 33: tokio::runtime::context::scoped::Scoped<T>::set at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/scoped.rs:40:9 34: tokio::runtime::context::set_scheduler::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:26 35: std::thread::local::LocalKey<T>::try_with at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:284:16 36: std::thread::local::LocalKey<T>::with at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:260:9 37: tokio::runtime::context::set_scheduler at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:9 38: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:486:9 39: tokio::runtime::context::runtime::enter_runtime at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/runtime.rs:65:16 40: tokio::runtime::scheduler::multi_thread::worker::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:478:5 41: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:447:45 42: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/task.rs:42:21 43: tokio::runtime::task::core::Core<T,S>::poll::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:328:17 44: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/loom/std/unsafe_cell.rs:16:9 tokio::runtime::task::core::Core<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:317:13 45: tokio::runtime::task::harness::poll_future::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:485:19 46: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 47: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 48: __rust_try 49: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 50: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 51: tokio::runtime::task::harness::poll_future at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:473:18 52: tokio::runtime::task::harness::Harness<T,S>::poll_inner at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:208:27 53: tokio::runtime::task::harness::Harness<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:153:15 54: tokio::runtime::task::raw::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:271:5 55: tokio::runtime::task::raw::RawTask::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:201:18 56: tokio::runtime::task::UnownedTask<S>::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/mod.rs:464:9 57: tokio::runtime::blocking::pool::Task::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:159:9 58: tokio::runtime::blocking::pool::Inner::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:513:17 59: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:471:13 60: std::sys_common::backtrace::__rust_begin_short_backtrace at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys_common/backtrace.rs:155:18 61: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:528:17 62: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 63: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 64: __rust_try 65: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 66: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 std::thread::Builder::spawn_unchecked_::{{closure}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:527:30 67: core::ops::function::FnOnce::call_once{{vtable.shim}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5 68: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9 <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9 std::sys::pal::unix::thread::Thread::new::thread_start at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/thread.rs:108:17 69: _thrp_setup 70: <unknown> file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
3792024-05-16T19:48:51.168ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
3802024-05-16T19:48:51.432ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::from_base::migration_from_base_and_back self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3812024-05-16T19:48:51.563ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 1543 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back vm_id = 7691511f-16f6-48f0-8f23-c3bf10a203b3
3822024-05-16T19:48:51.658ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::from_base::migration_from_base_and_back self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3832024-05-16T19:48:51.787ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::zfs vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3842024-05-16T19:48:51.787ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-a94a83df-da2f-4dce-b44f-2daccbd872bb"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::zfs verb = destroy vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3852024-05-16T19:48:51.822ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::zfs vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3862024-05-16T19:48:51.822ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-9c17d4df-7742-447e-a032-8c67cf8354ba"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::zfs verb = destroy vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3872024-05-16T19:48:51.845ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 1826 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_framework::test_vm vm = migration_from_base_and_back_lifecycle_0 vm_id = b4936a53-db62-4a1d-9a53-90d528e9e064
3882024-05-16T19:48:51.845ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 60208 file = phd-tests/tests/src/migrate.rs line = 50 path = phd_tests::migrate::from_base::migration_from_base_and_back target = phd_tests::migrate::from_base
3892024-05-16T19:48:51.846ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 677 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
3902024-05-16T19:48:51.846ZINFOphd-runner: Starting test phd_tests::migrate::from_base::serial_history file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
3912024-05-16T19:48:51.846ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
3922024-05-16T19:48:51.846ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
3932024-05-16T19:48:51.846ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 38 path = phd_tests::migrate::from_base::serial_history target = phd_tests::migrate::from_base
3942024-05-16T19:48:51.846ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
3952024-05-16T19:48:51.846ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
3962024-05-16T19:48:51.846ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
3972024-05-16T19:48:51.846ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::serial_history target = phd_framework::zfs verb = list
3982024-05-16T19:48:51.865ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::from_base::serial_history stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 803M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
3992024-05-16T19:48:51.865ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-e6c2bd97-683f-4fd0-bf7b-35078cb80d8c"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::serial_history target = phd_framework::zfs verb = snapshot
4002024-05-16T19:48:51.886ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-e6c2bd97-683f-4fd0-bf7b-35078cb80d8c", "phd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::serial_history target = phd_framework::zfs verb = clone
4012024-05-16T19:48:51.909ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::serial_history target = phd_framework::zfs verb = list
4022024-05-16T19:48:51.926ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::from_base::serial_history stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9 0B 1.80T 801M /phd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9\n target = phd_framework::zfs
4032024-05-16T19:48:51.926ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm
4042024-05-16T19:48:51.926ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__BASE_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::from_base::serial_history spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_serial_history_base
4052024-05-16T19:48:51.926ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/b58449462fa7fa216a1a261bdc5547beb5f611b5d9ec598f9126b3a7d4c7620d/propolis-server target = phd_framework::artifacts::store
4062024-05-16T19:48:51.927ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_serial_history_base.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::from_base::serial_history server_addr = 127.0.0.1:9000 server_path = "/phd-artifacts/b58449462fa7fa216a1a261bdc5547beb5f611b5d9ec598f9126b3a7d4c7620d/propolis-server" target = phd_framework::test_vm::server
4072024-05-16T19:48:51.927ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::from_base::serial_history stderr_path = "/tmp/propolis-phd/migration_serial_history_base.stderr.log" stdout_path = "/tmp/propolis-phd/migration_serial_history_base.stdout.log" target = phd_framework::server_log_mode
4082024-05-16T19:48:51.938ZINFOphd-runner: [NEW - EVENT] Launched server with pid 913 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm::server
4092024-05-16T19:48:51.938ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 12 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm
4102024-05-16T19:48:51.939ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4112024-05-16T19:48:51.939ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4122024-05-16T19:48:52.737ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
4132024-05-16T19:48:52.738ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: ee4b08ab-e232-4bc0-a75f-e4a0cb432829, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 42da8de5-389c-4573-9631-11b49de08fe4, silo_id: a492bfb8-6e49-4709-8dc6-c4ddf502c4fb }, name: "phd-vm-ee4b08ab-e232-4bc0-a75f-e4a0cb432829", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::from_base::serial_history self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4142024-05-16T19:48:52.738ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 799 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4152024-05-16T19:48:52.738ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4162024-05-16T19:48:52.738ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::from_base::serial_history state = Run target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4172024-05-16T19:48:52.739ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4182024-05-16T19:48:52.739ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm
4192024-05-16T19:48:52.739ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm timeout_duration = 300s vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4202024-05-16T19:48:52.739ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::serial_history step = WaitFor("localhost login: ") target = phd_framework::test_vm
4212024-05-16T19:48:52.739ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4222024-05-16T19:48:52.739ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4232024-05-16T19:48:56.982ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4243 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4242024-05-16T19:48:56.982ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::serial_history step = WriteStr("root") target = phd_framework::test_vm
4252024-05-16T19:48:56.982ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::serial_history step = WaitFor("localhost:~#") target = phd_framework::test_vm
4262024-05-16T19:48:56.982ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4272024-05-16T19:48:56.983ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4282024-05-16T19:48:57.003ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4292024-05-16T19:48:57.003ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm
4302024-05-16T19:48:57.003ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4264 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm
4312024-05-16T19:48:57.003ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4322024-05-16T19:48:57.004ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4332024-05-16T19:48:57.013ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 9 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4342024-05-16T19:48:57.013ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4352024-05-16T19:48:57.013ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4362024-05-16T19:48:57.043ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 30 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4372024-05-16T19:48:57.049ZINFOphd-runner: [TEST - EVENT] migrating to new Propolis artifact for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 74 path = phd_tests::migrate::from_base::serial_history propolis_artifact = __DEFAULT_PROPOLIS target = phd_framework::lifecycle vm_name = migration_serial_history_base
4382024-05-16T19:48:57.049ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm
4392024-05-16T19:48:57.049ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::from_base::serial_history spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_serial_history_base_lifecycle_0
4402024-05-16T19:48:57.049ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
4412024-05-16T19:48:57.049ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_serial_history_base_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::from_base::serial_history server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
4422024-05-16T19:48:57.049ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::from_base::serial_history stderr_path = "/tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
4432024-05-16T19:48:57.066ZINFOphd-runner: [NEW - EVENT] Launched server with pid 914 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm::server
4442024-05-16T19:48:57.067ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 18 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm
4452024-05-16T19:48:57.067ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4462024-05-16T19:48:57.067ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 232b676b-4632-4bbd-abf0-7fdeb6d734ee path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729 timeout_duration = 45s
4472024-05-16T19:48:57.067ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729 vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4482024-05-16T19:48:57.068ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729 vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4492024-05-16T19:48:57.493ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 70b9b487-0ed3-4c62-9b38-1467ad30c729, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 08d0a110-2df4-407e-86ca-e7b121e5b22f, silo_id: 39c52a47-38a7-4081-a604-afae52df95b9 }, name: "phd-vm-70b9b487-0ed3-4c62-9b38-1467ad30c729", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::from_base::serial_history self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729 vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4502024-05-16T19:48:57.493ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 425 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729 vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4512024-05-16T19:48:57.493ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 232b676b-4632-4bbd-abf0-7fdeb6d734ee path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4522024-05-16T19:49:01.447ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 537 path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4532024-05-16T19:49:01.447ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 3954 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 232b676b-4632-4bbd-abf0-7fdeb6d734ee path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4542024-05-16T19:49:01.447ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4379 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::from_base::serial_history source = migration_serial_history_base source_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829 target = phd_framework::test_vm target_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4552024-05-16T19:49:01.447ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4562024-05-16T19:49:01.447ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4572024-05-16T19:49:01.449ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4582024-05-16T19:49:01.449ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4592024-05-16T19:49:01.460ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
4602024-05-16T19:49:01.460ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 8722 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
4612024-05-16T19:49:01.460ZINFOphd-runner: test phd_tests::migrate::from_base::serial_history ... FAILED: live migration Caused by: error during migration Stack backtrace: 0: anyhow::__private::format_err at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.75/src/lib.rs:675:13 1: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:538:59 2: <backoff::future::Retry<S,B,N,Fn,Fut> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/backoff-0.4.0/src/future.rs:182:26 3: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:555:18 4: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.37/src/instrument.rs:272:9 5: phd_framework::test_vm::TestVm::migrate_from::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:471:5 6: phd_framework::lifecycle::<impl phd_framework::Framework>::lifecycle_test::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/lifecycle.rs:95:26 7: phd_tests::migrate::run_serial_history_test::{{closure}} at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:372:6 8: phd_tests::migrate::from_base::serial_history::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:44:10 9: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.37/src/instrument.rs:272:9 10: phd_tests::migrate::from_base::serial_history::{{closure}} at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:38:5 11: <core::pin::Pin<P> as core::future::future::Future>::poll at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/future/future.rs:123:9 12: phd_testcase::TestCase::run::{{closure}} at ./oxidecomputer/propolis/phd-tests/testcase/src/lib.rs:79:32 13: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/macros/select.rs:524:49 14: <tokio::future::poll_fn::PollFn<F> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/future/poll_fn.rs:58:9 15: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/runner/src/execute.rs:105:13 16: tokio::runtime::task::core::Core<T,S>::poll::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:328:17 17: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/loom/std/unsafe_cell.rs:16:9 tokio::runtime::task::core::Core<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:317:13 18: tokio::runtime::task::harness::poll_future::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:485:19 19: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 20: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 21: __rust_try 22: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 23: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 24: tokio::runtime::task::harness::poll_future at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:473:18 25: tokio::runtime::task::harness::Harness<T,S>::poll_inner at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:208:27 26: tokio::runtime::task::harness::Harness<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:153:15 27: tokio::runtime::task::raw::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:271:5 28: tokio::runtime::task::raw::RawTask::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:201:18 29: tokio::runtime::task::LocalNotified<S>::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/mod.rs:427:9 30: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:639:17 31: tokio::runtime::coop::with_budget at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:107:5 tokio::runtime::coop::budget at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:73:5 tokio::runtime::scheduler::multi_thread::worker::Context::run_task at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:575:9 32: tokio::runtime::scheduler::multi_thread::worker::Context::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:526:24 33: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:491:21 34: tokio::runtime::context::scoped::Scoped<T>::set at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/scoped.rs:40:9 35: tokio::runtime::context::set_scheduler::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:26 36: std::thread::local::LocalKey<T>::try_with at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:284:16 37: std::thread::local::LocalKey<T>::with at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:260:9 38: tokio::runtime::context::set_scheduler at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:9 39: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:486:9 40: tokio::runtime::context::runtime::enter_runtime at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/runtime.rs:65:16 41: tokio::runtime::scheduler::multi_thread::worker::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:478:5 42: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:447:45 43: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/task.rs:42:21 44: tokio::runtime::task::core::Core<T,S>::poll::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:328:17 45: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/loom/std/unsafe_cell.rs:16:9 tokio::runtime::task::core::Core<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:317:13 46: tokio::runtime::task::harness::poll_future::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:485:19 47: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 48: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 49: __rust_try 50: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 51: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 52: tokio::runtime::task::harness::poll_future at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:473:18 53: tokio::runtime::task::harness::Harness<T,S>::poll_inner at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:208:27 54: tokio::runtime::task::harness::Harness<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:153:15 55: tokio::runtime::task::raw::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:271:5 56: tokio::runtime::task::raw::RawTask::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:201:18 57: tokio::runtime::task::UnownedTask<S>::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/mod.rs:464:9 58: tokio::runtime::blocking::pool::Task::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:159:9 59: tokio::runtime::blocking::pool::Inner::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:513:17 60: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:471:13 61: std::sys_common::backtrace::__rust_begin_short_backtrace at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys_common/backtrace.rs:155:18 62: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:528:17 63: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 64: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 65: __rust_try 66: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 67: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 std::thread::Builder::spawn_unchecked_::{{closure}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:527:30 68: core::ops::function::FnOnce::call_once{{vtable.shim}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5 69: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9 <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9 std::sys::pal::unix::thread::Thread::new::thread_start at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/thread.rs:108:17 70: _thrp_setup 71: <unknown> file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
4622024-05-16T19:49:01.460ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
4632024-05-16T19:49:01.946ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::from_base::serial_history self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4642024-05-16T19:49:02.080ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 632 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base vm_id = ee4b08ab-e232-4bc0-a75f-e4a0cb432829
4652024-05-16T19:49:02.081ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::from_base::serial_history self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4662024-05-16T19:49:02.210ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::from_base::serial_history target = phd_framework::zfs vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4672024-05-16T19:49:02.211ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-0ff15f49-4282-433e-960d-8aafb88a82d9"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::serial_history target = phd_framework::zfs verb = destroy vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4682024-05-16T19:49:02.247ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::from_base::serial_history target = phd_framework::zfs vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4692024-05-16T19:49:02.247ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-e6c2bd97-683f-4fd0-bf7b-35078cb80d8c"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::serial_history target = phd_framework::zfs verb = destroy vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4702024-05-16T19:49:02.278ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 830 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::serial_history target = phd_framework::test_vm vm = migration_serial_history_base_lifecycle_0 vm_id = 70b9b487-0ed3-4c62-9b38-1467ad30c729
4712024-05-16T19:49:02.278ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 10432 file = phd-tests/tests/src/migrate.rs line = 38 path = phd_tests::migrate::from_base::serial_history target = phd_tests::migrate::from_base
4722024-05-16T19:49:02.279ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 818 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
4732024-05-16T19:49:02.279ZINFOphd-runner: Starting test phd_tests::migrate::from_base::can_migrate_from_base file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
4742024-05-16T19:49:02.279ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
4752024-05-16T19:49:02.279ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
4762024-05-16T19:49:02.279ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 32 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_tests::migrate::from_base
4772024-05-16T19:49:02.279ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
4782024-05-16T19:49:02.279ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
4792024-05-16T19:49:02.279ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
4802024-05-16T19:49:02.279ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::zfs verb = list
4812024-05-16T19:49:02.298ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::from_base::can_migrate_from_base stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 803M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
4822024-05-16T19:49:02.298ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-adcfbf68-4dd6-4ce2-82ba-42613429ecc2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::zfs verb = snapshot
4832024-05-16T19:49:02.318ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-adcfbf68-4dd6-4ce2-82ba-42613429ecc2", "phd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::zfs verb = clone
4842024-05-16T19:49:02.340ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::zfs verb = list
4852024-05-16T19:49:02.355ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::from_base::can_migrate_from_base stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2 0B 1.80T 801M /phd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2\n target = phd_framework::zfs
4862024-05-16T19:49:02.355ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm
4872024-05-16T19:49:02.355ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__BASE_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::from_base::can_migrate_from_base spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_from_base
4882024-05-16T19:49:02.356ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/b58449462fa7fa216a1a261bdc5547beb5f611b5d9ec598f9126b3a7d4c7620d/propolis-server target = phd_framework::artifacts::store
4892024-05-16T19:49:02.356ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_from_base.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::from_base::can_migrate_from_base server_addr = 127.0.0.1:9000 server_path = "/phd-artifacts/b58449462fa7fa216a1a261bdc5547beb5f611b5d9ec598f9126b3a7d4c7620d/propolis-server" target = phd_framework::test_vm::server
4902024-05-16T19:49:02.356ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::from_base::can_migrate_from_base stderr_path = "/tmp/propolis-phd/migration_from_base.stderr.log" stdout_path = "/tmp/propolis-phd/migration_from_base.stdout.log" target = phd_framework::server_log_mode
4912024-05-16T19:49:02.366ZINFOphd-runner: [NEW - EVENT] Launched server with pid 923 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm::server
4922024-05-16T19:49:02.367ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm
4932024-05-16T19:49:02.367ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
4942024-05-16T19:49:02.367ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
4952024-05-16T19:49:03.049ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
4962024-05-16T19:49:03.050ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: e4ae5344-3c9f-4a32-a563-fd549df3bf7e, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: cf546e12-e589-40ba-a7af-84c069a48df0, silo_id: 1ff2293d-17c0-4b7f-ba64-24580a142000 }, name: "phd-vm-e4ae5344-3c9f-4a32-a563-fd549df3bf7e", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::from_base::can_migrate_from_base self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
4972024-05-16T19:49:03.050ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 683 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
4982024-05-16T19:49:03.050ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
4992024-05-16T19:49:03.050ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::from_base::can_migrate_from_base state = Run target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5002024-05-16T19:49:03.051ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5012024-05-16T19:49:03.051ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm
5022024-05-16T19:49:03.051ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = 300s vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5032024-05-16T19:49:03.051ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::can_migrate_from_base step = WaitFor("localhost login: ") target = phd_framework::test_vm
5042024-05-16T19:49:03.051ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5052024-05-16T19:49:03.051ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5062024-05-16T19:49:07.314ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4262 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5072024-05-16T19:49:07.314ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::can_migrate_from_base step = WriteStr("root") target = phd_framework::test_vm
5082024-05-16T19:49:07.314ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::from_base::can_migrate_from_base step = WaitFor("localhost:~#") target = phd_framework::test_vm
5092024-05-16T19:49:07.314ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5102024-05-16T19:49:07.314ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5112024-05-16T19:49:07.335ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5122024-05-16T19:49:07.335ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm
5132024-05-16T19:49:07.335ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4284 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm
5142024-05-16T19:49:07.335ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5152024-05-16T19:49:07.335ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5162024-05-16T19:49:07.341ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5172024-05-16T19:49:07.341ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5182024-05-16T19:49:07.341ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5192024-05-16T19:49:07.373ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 31 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5202024-05-16T19:49:07.373ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5212024-05-16T19:49:07.373ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5222024-05-16T19:49:07.384ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5232024-05-16T19:49:07.385ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5242024-05-16T19:49:07.385ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5252024-05-16T19:49:07.417ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5262024-05-16T19:49:07.418ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5272024-05-16T19:49:07.418ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5282024-05-16T19:49:07.428ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5292024-05-16T19:49:07.428ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5302024-05-16T19:49:07.428ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5312024-05-16T19:49:07.450ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5322024-05-16T19:49:07.451ZINFOphd-runner: [TEST - EVENT] migrating to new Propolis artifact for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 74 path = phd_tests::migrate::from_base::can_migrate_from_base propolis_artifact = __DEFAULT_PROPOLIS target = phd_framework::lifecycle vm_name = migration_from_base
5332024-05-16T19:49:07.451ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm
5342024-05-16T19:49:07.451ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::from_base::can_migrate_from_base spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_from_base_lifecycle_0
5352024-05-16T19:49:07.451ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
5362024-05-16T19:49:07.451ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_from_base_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::from_base::can_migrate_from_base server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
5372024-05-16T19:49:07.451ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::from_base::can_migrate_from_base stderr_path = "/tmp/propolis-phd/migration_from_base_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_from_base_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
5382024-05-16T19:49:07.469ZINFOphd-runner: [NEW - EVENT] Launched server with pid 924 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm::server
5392024-05-16T19:49:07.469ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 18 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm
5402024-05-16T19:49:07.469ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5412024-05-16T19:49:07.469ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 1cf33d93-fb81-47eb-a7ba-8d14cd40649d path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b timeout_duration = 45s
5422024-05-16T19:49:07.469ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b vm = migration_from_base_lifecycle_0 vm_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5432024-05-16T19:49:07.470ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b vm = migration_from_base_lifecycle_0 vm_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5442024-05-16T19:49:07.852ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 6bd56ef5-4413-443f-8a99-037c47757c5b, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 2f791993-9adc-479d-8286-1774829cc775, silo_id: 7dff5504-1bc3-49d4-b9cf-6ab4726884ee }, name: "phd-vm-6bd56ef5-4413-443f-8a99-037c47757c5b", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::from_base::can_migrate_from_base self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b vm = migration_from_base_lifecycle_0 vm_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5452024-05-16T19:49:07.852ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 382 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b vm = migration_from_base_lifecycle_0 vm_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5462024-05-16T19:49:07.852ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 1cf33d93-fb81-47eb-a7ba-8d14cd40649d path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5472024-05-16T19:49:12.768ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 537 path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5482024-05-16T19:49:12.769ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4916 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 1cf33d93-fb81-47eb-a7ba-8d14cd40649d path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5492024-05-16T19:49:12.769ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 5299 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::from_base::can_migrate_from_base source = migration_from_base source_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e target = phd_framework::test_vm target_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5502024-05-16T19:49:12.769ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base_lifecycle_0 vm_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5512024-05-16T19:49:12.769ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5522024-05-16T19:49:12.770ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base_lifecycle_0 vm_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5532024-05-16T19:49:12.770ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5542024-05-16T19:49:12.772ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
5552024-05-16T19:49:12.772ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 9722 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
5562024-05-16T19:49:12.772ZINFOphd-runner: test phd_tests::migrate::from_base::can_migrate_from_base ... FAILED: live migration Caused by: error during migration Stack backtrace: 0: anyhow::__private::format_err at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.75/src/lib.rs:675:13 1: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:538:59 2: <backoff::future::Retry<S,B,N,Fn,Fut> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/backoff-0.4.0/src/future.rs:182:26 3: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:555:18 4: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.37/src/instrument.rs:272:9 5: phd_framework::test_vm::TestVm::migrate_from::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:471:5 6: phd_framework::lifecycle::<impl phd_framework::Framework>::lifecycle_test::{{closure}} at ./oxidecomputer/propolis/phd-tests/framework/src/lifecycle.rs:95:26 7: phd_tests::migrate::run_smoke_test::{{closure}} at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:334:6 8: phd_tests::migrate::from_base::can_migrate_from_base::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:35:14 9: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.37/src/instrument.rs:272:9 10: phd_tests::migrate::from_base::can_migrate_from_base::{{closure}} at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:32:5 11: <core::pin::Pin<P> as core::future::future::Future>::poll at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/future/future.rs:123:9 12: phd_testcase::TestCase::run::{{closure}} at ./oxidecomputer/propolis/phd-tests/testcase/src/lib.rs:79:32 13: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/macros/select.rs:524:49 14: <tokio::future::poll_fn::PollFn<F> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/future/poll_fn.rs:58:9 15: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}} at ./oxidecomputer/propolis/phd-tests/runner/src/execute.rs:105:13 16: tokio::runtime::task::core::Core<T,S>::poll::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:328:17 17: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/loom/std/unsafe_cell.rs:16:9 tokio::runtime::task::core::Core<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:317:13 18: tokio::runtime::task::harness::poll_future::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:485:19 19: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 20: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 21: __rust_try 22: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 23: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 24: tokio::runtime::task::harness::poll_future at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:473:18 25: tokio::runtime::task::harness::Harness<T,S>::poll_inner at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:208:27 26: tokio::runtime::task::harness::Harness<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:153:15 27: tokio::runtime::task::raw::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:271:5 28: tokio::runtime::task::raw::RawTask::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:201:18 29: tokio::runtime::task::LocalNotified<S>::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/mod.rs:427:9 30: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:639:17 31: tokio::runtime::coop::with_budget at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:107:5 tokio::runtime::coop::budget at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:73:5 tokio::runtime::scheduler::multi_thread::worker::Context::run_task at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:575:9 32: tokio::runtime::scheduler::multi_thread::worker::Context::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:526:24 33: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:491:21 34: tokio::runtime::context::scoped::Scoped<T>::set at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/scoped.rs:40:9 35: tokio::runtime::context::set_scheduler::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:26 36: std::thread::local::LocalKey<T>::try_with at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:284:16 37: std::thread::local::LocalKey<T>::with at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:260:9 38: tokio::runtime::context::set_scheduler at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:9 39: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:486:9 40: tokio::runtime::context::runtime::enter_runtime at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/runtime.rs:65:16 41: tokio::runtime::scheduler::multi_thread::worker::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:478:5 42: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/multi_thread/worker.rs:447:45 43: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/task.rs:42:21 44: tokio::runtime::task::core::Core<T,S>::poll::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:328:17 45: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/loom/std/unsafe_cell.rs:16:9 tokio::runtime::task::core::Core<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:317:13 46: tokio::runtime::task::harness::poll_future::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:485:19 47: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 48: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 49: __rust_try 50: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 51: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 52: tokio::runtime::task::harness::poll_future at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:473:18 53: tokio::runtime::task::harness::Harness<T,S>::poll_inner at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:208:27 54: tokio::runtime::task::harness::Harness<T,S>::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:153:15 55: tokio::runtime::task::raw::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:271:5 56: tokio::runtime::task::raw::RawTask::poll at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:201:18 57: tokio::runtime::task::UnownedTask<S>::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/mod.rs:464:9 58: tokio::runtime::blocking::pool::Task::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:159:9 59: tokio::runtime::blocking::pool::Inner::run at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:513:17 60: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/blocking/pool.rs:471:13 61: std::sys_common::backtrace::__rust_begin_short_backtrace at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys_common/backtrace.rs:155:18 62: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:528:17 63: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9 64: std::panicking::try::do_call at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40 65: __rust_try 66: std::panicking::try at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19 67: std::panic::catch_unwind at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14 std::thread::Builder::spawn_unchecked_::{{closure}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:527:30 68: core::ops::function::FnOnce::call_once{{vtable.shim}} at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5 69: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9 <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9 std::sys::pal::unix::thread::Thread::new::thread_start at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/thread.rs:108:17 70: _thrp_setup 71: <unknown> file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
5572024-05-16T19:49:12.772ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
5582024-05-16T19:49:13.176ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::from_base::can_migrate_from_base self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_from_base_lifecycle_0 vm_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5592024-05-16T19:49:13.295ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 525 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base_lifecycle_0 vm_id = 6bd56ef5-4413-443f-8a99-037c47757c5b
5602024-05-16T19:49:13.296ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::from_base::can_migrate_from_base self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5612024-05-16T19:49:13.423ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::zfs vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5622024-05-16T19:49:13.423ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-ec537982-f3dd-4564-a86b-e2fa932d61f2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::zfs verb = destroy vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5632024-05-16T19:49:13.458ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::zfs vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5642024-05-16T19:49:13.458ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-adcfbf68-4dd6-4ce2-82ba-42613429ecc2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::zfs verb = destroy vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5652024-05-16T19:49:13.486ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 716 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_framework::test_vm vm = migration_from_base vm_id = e4ae5344-3c9f-4a32-a563-fd549df3bf7e
5662024-05-16T19:49:13.486ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 11206 file = phd-tests/tests/src/migrate.rs line = 32 path = phd_tests::migrate::from_base::can_migrate_from_base target = phd_tests::migrate::from_base
5672024-05-16T19:49:13.486ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 713 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
5682024-05-16T19:49:13.486ZINFOphd-runner: Starting test phd_tests::server_state_machine::instance_reset_requires_running_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
5692024-05-16T19:49:13.486ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
5702024-05-16T19:49:13.486ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
5712024-05-16T19:49:13.486ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/server_state_machine.rs line = 83 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_tests::server_state_machine
5722024-05-16T19:49:13.486ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
5732024-05-16T19:49:13.486ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
5742024-05-16T19:49:13.486ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
5752024-05-16T19:49:13.487ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = list
5762024-05-16T19:49:13.503ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_reset_requires_running_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
5772024-05-16T19:49:13.503ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-b2e3b1a7-837d-416d-9821-7573d764dce8"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = snapshot
5782024-05-16T19:49:13.524ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-b2e3b1a7-837d-416d-9821-7573d764dce8", "phd-artifacts/phd-clone-9419ccda-2215-4755-9316-1ac2763d4356"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = clone
5792024-05-16T19:49:13.546ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-9419ccda-2215-4755-9316-1ac2763d4356"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = list
5802024-05-16T19:49:13.562ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_reset_requires_running_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-9419ccda-2215-4755-9316-1ac2763d4356 0B 1.80T 801M /phd-artifacts/phd-clone-9419ccda-2215-4755-9316-1ac2763d4356\n target = phd_framework::zfs
5812024-05-16T19:49:13.563ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm
5822024-05-16T19:49:13.563ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::server_state_machine::instance_reset_requires_running_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9419ccda-2215-4755-9316-1ac2763d4356/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = instance_reset_requires_running_test
5832024-05-16T19:49:13.563ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
5842024-05-16T19:49:13.563ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_reset_requires_running_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::server_state_machine::instance_reset_requires_running_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
5852024-05-16T19:49:13.563ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::server_state_machine::instance_reset_requires_running_test stderr_path = "/tmp/propolis-phd/instance_reset_requires_running_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_reset_requires_running_test.stdout.log" target = phd_framework::server_log_mode
5862024-05-16T19:49:13.573ZINFOphd-runner: [NEW - EVENT] Launched server with pid 933 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm::server
5872024-05-16T19:49:13.574ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm
5882024-05-16T19:49:13.574ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5892024-05-16T19:49:13.574ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_requires_running_test state = Reboot target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5902024-05-16T19:49:13.574ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5912024-05-16T19:49:13.574ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5922024-05-16T19:49:13.574ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5932024-05-16T19:49:14.394ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
5942024-05-16T19:49:14.395ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 8de32f67-b0f8-415e-9a54-1a16cfadc41d, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 86a3ef41-069d-4525-9b9a-3ba2853f40ae, silo_id: 871e985c-a6d4-403e-a109-8d43c96d4641 }, name: "phd-vm-8de32f67-b0f8-415e-9a54-1a16cfadc41d", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::server_state_machine::instance_reset_requires_running_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9419ccda-2215-4755-9316-1ac2763d4356/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5952024-05-16T19:49:14.395ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 820 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5962024-05-16T19:49:14.395ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5972024-05-16T19:49:14.395ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_requires_running_test state = Run target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5982024-05-16T19:49:14.395ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
5992024-05-16T19:49:14.396ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6002024-05-16T19:49:14.396ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 598 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6012024-05-16T19:49:14.396ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6022024-05-16T19:49:14.396ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6032024-05-16T19:49:14.396ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6042024-05-16T19:49:14.396ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6052024-05-16T19:49:14.396ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6062024-05-16T19:49:14.396ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
6072024-05-16T19:49:14.397ZINFOphd-runner: test phd_tests::server_state_machine::instance_reset_requires_running_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
6082024-05-16T19:49:14.397ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 2 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
6092024-05-16T19:49:14.397ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
6102024-05-16T19:49:14.397ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6112024-05-16T19:49:14.983ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::server_state_machine::instance_reset_requires_running_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6122024-05-16T19:49:15.113ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6132024-05-16T19:49:15.114ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-9419ccda-2215-4755-9316-1ac2763d4356"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = destroy vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6142024-05-16T19:49:15.151ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6152024-05-16T19:49:15.151ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-b2e3b1a7-837d-416d-9821-7573d764dce8"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = destroy vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6162024-05-16T19:49:15.175ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 778 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 8de32f67-b0f8-415e-9a54-1a16cfadc41d
6172024-05-16T19:49:15.175ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 1688 file = phd-tests/tests/src/server_state_machine.rs line = 83 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_tests::server_state_machine
6182024-05-16T19:49:15.175ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 778 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
6192024-05-16T19:49:15.175ZINFOphd-runner: Starting test phd_tests::server_state_machine::instance_reset_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
6202024-05-16T19:49:15.175ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
6212024-05-16T19:49:15.175ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
6222024-05-16T19:49:15.175ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/server_state_machine.rs line = 52 path = phd_tests::server_state_machine::instance_reset_test target = phd_tests::server_state_machine
6232024-05-16T19:49:15.176ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
6242024-05-16T19:49:15.176ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
6252024-05-16T19:49:15.176ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
6262024-05-16T19:49:15.176ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = list
6272024-05-16T19:49:15.191ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_reset_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
6282024-05-16T19:49:15.192ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-dfa208ac-f33a-4db7-b423-2848518df161"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = snapshot
6292024-05-16T19:49:15.211ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-dfa208ac-f33a-4db7-b423-2848518df161", "phd-artifacts/phd-clone-158eec8d-922e-4ee6-8c0d-4cefe5fd2d17"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = clone
6302024-05-16T19:49:15.234ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-158eec8d-922e-4ee6-8c0d-4cefe5fd2d17"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = list
6312024-05-16T19:49:15.252ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_reset_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-158eec8d-922e-4ee6-8c0d-4cefe5fd2d17 0B 1.80T 801M /phd-artifacts/phd-clone-158eec8d-922e-4ee6-8c0d-4cefe5fd2d17\n target = phd_framework::zfs
6322024-05-16T19:49:15.253ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm
6332024-05-16T19:49:15.253ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::server_state_machine::instance_reset_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-158eec8d-922e-4ee6-8c0d-4cefe5fd2d17/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = instance_reset_returns_to_running_test
6342024-05-16T19:49:15.253ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
6352024-05-16T19:49:15.253ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_reset_returns_to_running_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::server_state_machine::instance_reset_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
6362024-05-16T19:49:15.253ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::server_state_machine::instance_reset_test stderr_path = "/tmp/propolis-phd/instance_reset_returns_to_running_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_reset_returns_to_running_test.stdout.log" target = phd_framework::server_log_mode
6372024-05-16T19:49:15.265ZINFOphd-runner: [NEW - EVENT] Launched server with pid 941 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm::server
6382024-05-16T19:49:15.266ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 12 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm
6392024-05-16T19:49:15.266ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6402024-05-16T19:49:15.266ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6412024-05-16T19:49:15.266ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6422024-05-16T19:49:15.266ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6432024-05-16T19:49:15.267ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6442024-05-16T19:49:15.934ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
6452024-05-16T19:49:15.934ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 5039df88-16f1-4716-a276-e2fa70cacbfc, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 0c6959ce-2b09-4b4b-94b7-8d0003b034a8, silo_id: 0971d011-a18f-42d5-bc4f-07249c35b992 }, name: "phd-vm-5039df88-16f1-4716-a276-e2fa70cacbfc", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::server_state_machine::instance_reset_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-158eec8d-922e-4ee6-8c0d-4cefe5fd2d17/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6462024-05-16T19:49:15.935ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 668 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6472024-05-16T19:49:15.935ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6482024-05-16T19:49:15.935ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Run target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6492024-05-16T19:49:15.935ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6502024-05-16T19:49:15.935ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6512024-05-16T19:49:15.935ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 598 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6522024-05-16T19:49:15.935ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6532024-05-16T19:49:15.935ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6542024-05-16T19:49:15.936ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6552024-05-16T19:49:15.936ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6562024-05-16T19:49:15.936ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6572024-05-16T19:49:15.936ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6582024-05-16T19:49:15.937ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6592024-05-16T19:49:15.937ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6602024-05-16T19:49:15.937ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 598 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6612024-05-16T19:49:15.937ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6622024-05-16T19:49:15.937ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6632024-05-16T19:49:15.937ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6642024-05-16T19:49:16.244ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6652024-05-16T19:49:16.244ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6662024-05-16T19:49:16.244ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6672024-05-16T19:49:16.244ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 307 file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6682024-05-16T19:49:16.244ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6692024-05-16T19:49:16.244ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6702024-05-16T19:49:16.245ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6712024-05-16T19:49:16.245ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6722024-05-16T19:49:16.245ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6732024-05-16T19:49:16.245ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6742024-05-16T19:49:16.246ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6752024-05-16T19:49:16.246ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6762024-05-16T19:49:16.246ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6772024-05-16T19:49:16.246ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6782024-05-16T19:49:16.246ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6792024-05-16T19:49:16.247ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6802024-05-16T19:49:16.247ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6812024-05-16T19:49:16.247ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6822024-05-16T19:49:16.247ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6832024-05-16T19:49:16.247ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6842024-05-16T19:49:16.247ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6852024-05-16T19:49:16.248ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6862024-05-16T19:49:16.248ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6872024-05-16T19:49:16.248ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6882024-05-16T19:49:16.248ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6892024-05-16T19:49:16.248ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6902024-05-16T19:49:16.248ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6912024-05-16T19:49:16.249ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6922024-05-16T19:49:16.249ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6932024-05-16T19:49:16.249ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6942024-05-16T19:49:16.249ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6952024-05-16T19:49:16.250ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6962024-05-16T19:49:16.250ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6972024-05-16T19:49:16.250ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6982024-05-16T19:49:16.250ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
6992024-05-16T19:49:16.250ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 598 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7002024-05-16T19:49:16.250ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7012024-05-16T19:49:16.250ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7022024-05-16T19:49:16.251ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7032024-05-16T19:49:16.251ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7042024-05-16T19:49:16.251ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7052024-05-16T19:49:16.251ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Stop target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7062024-05-16T19:49:16.251ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7072024-05-16T19:49:16.251ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7082024-05-16T19:49:16.251ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 598 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7092024-05-16T19:49:16.251ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7102024-05-16T19:49:16.251ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7112024-05-16T19:49:16.252ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
7122024-05-16T19:49:16.252ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 317 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
7132024-05-16T19:49:16.252ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7142024-05-16T19:49:16.595ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7152024-05-16T19:49:16.595ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7162024-05-16T19:49:16.597ZINFOphd-runner: [GET - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7172024-05-16T19:49:16.597ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 345 file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7182024-05-16T19:49:16.597ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7192024-05-16T19:49:16.597ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7202024-05-16T19:49:16.597ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7212024-05-16T19:49:16.597ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7222024-05-16T19:49:16.598ZINFOphd-runner: test phd_tests::server_state_machine::instance_reset_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
7232024-05-16T19:49:16.598ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
7242024-05-16T19:49:16.598ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::server_state_machine::instance_reset_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7252024-05-16T19:49:16.716ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7262024-05-16T19:49:16.716ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-158eec8d-922e-4ee6-8c0d-4cefe5fd2d17"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = destroy vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7272024-05-16T19:49:16.754ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7282024-05-16T19:49:16.754ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-dfa208ac-f33a-4db7-b423-2848518df161"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = destroy vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7292024-05-16T19:49:16.779ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 181 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = 5039df88-16f1-4716-a276-e2fa70cacbfc
7302024-05-16T19:49:16.779ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 1603 file = phd-tests/tests/src/server_state_machine.rs line = 52 path = phd_tests::server_state_machine::instance_reset_test target = phd_tests::server_state_machine
7312024-05-16T19:49:16.779ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 181 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
7322024-05-16T19:49:16.779ZINFOphd-runner: Starting test phd_tests::server_state_machine::instance_stop_causes_destroy_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
7332024-05-16T19:49:16.779ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
7342024-05-16T19:49:16.779ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
7352024-05-16T19:49:16.779ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/server_state_machine.rs line = 28 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_tests::server_state_machine
7362024-05-16T19:49:16.779ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
7372024-05-16T19:49:16.779ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7382024-05-16T19:49:16.780ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7392024-05-16T19:49:16.780ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = list
7402024-05-16T19:49:16.798ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 801M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
7412024-05-16T19:49:16.798ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-d6cacbad-1f90-4f2c-9afa-a7c7ea49927d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = snapshot
7422024-05-16T19:49:16.822ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-d6cacbad-1f90-4f2c-9afa-a7c7ea49927d", "phd-artifacts/phd-clone-dfe7b424-c35f-46eb-94b1-89fbb316852a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = clone
7432024-05-16T19:49:16.845ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-dfe7b424-c35f-46eb-94b1-89fbb316852a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = list
7442024-05-16T19:49:16.862ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-dfe7b424-c35f-46eb-94b1-89fbb316852a 0B 1.80T 801M /phd-artifacts/phd-clone-dfe7b424-c35f-46eb-94b1-89fbb316852a\n target = phd_framework::zfs
7452024-05-16T19:49:16.862ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm
7462024-05-16T19:49:16.862ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-dfe7b424-c35f-46eb-94b1-89fbb316852a/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = instance_stop_causes_destroy_test
7472024-05-16T19:49:16.863ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
7482024-05-16T19:49:16.863ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_stop_causes_destroy_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
7492024-05-16T19:49:16.863ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test stderr_path = "/tmp/propolis-phd/instance_stop_causes_destroy_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_stop_causes_destroy_test.stdout.log" target = phd_framework::server_log_mode
7502024-05-16T19:49:16.874ZINFOphd-runner: [NEW - EVENT] Launched server with pid 949 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm::server
7512024-05-16T19:49:16.875ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 12 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm
7522024-05-16T19:49:16.875ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7532024-05-16T19:49:16.875ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7542024-05-16T19:49:17.571ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
7552024-05-16T19:49:17.572ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 0f457bc7-414b-4570-ab5f-8b82ffa091e7, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: a0c15834-ecd6-4fac-acb8-0aa3f11e7f61, silo_id: 515a3d97-35d5-4e6f-8035-2fc6ab3fc198 }, name: "phd-vm-0f457bc7-414b-4570-ab5f-8b82ffa091e7", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-dfe7b424-c35f-46eb-94b1-89fbb316852a/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7562024-05-16T19:49:17.572ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 697 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7572024-05-16T19:49:17.572ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7582024-05-16T19:49:17.572ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Run target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7592024-05-16T19:49:17.572ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7602024-05-16T19:49:17.572ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7612024-05-16T19:49:17.573ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Stop target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7622024-05-16T19:49:17.573ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7632024-05-16T19:49:17.573ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7642024-05-16T19:49:17.573ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 598 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7652024-05-16T19:49:17.573ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7662024-05-16T19:49:17.573ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7672024-05-16T19:49:17.574ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
7682024-05-16T19:49:17.574ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 3 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
7692024-05-16T19:49:17.574ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7702024-05-16T19:49:18.140ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7712024-05-16T19:49:18.140ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7722024-05-16T19:49:18.142ZINFOphd-runner: [GET - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7732024-05-16T19:49:18.142ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 568 file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7742024-05-16T19:49:18.142ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7752024-05-16T19:49:18.142ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Run target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7762024-05-16T19:49:18.142ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7772024-05-16T19:49:18.142ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7782024-05-16T19:49:18.142ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Stop target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7792024-05-16T19:49:18.143ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7802024-05-16T19:49:18.143ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7812024-05-16T19:49:18.143ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Reboot target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7822024-05-16T19:49:18.144ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7832024-05-16T19:49:18.144ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7842024-05-16T19:49:18.144ZINFOphd-runner: test phd_tests::server_state_machine::instance_stop_causes_destroy_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
7852024-05-16T19:49:18.144ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
7862024-05-16T19:49:18.144ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7872024-05-16T19:49:18.279ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7882024-05-16T19:49:18.279ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-dfe7b424-c35f-46eb-94b1-89fbb316852a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = destroy vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7892024-05-16T19:49:18.318ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7902024-05-16T19:49:18.318ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-d6cacbad-1f90-4f2c-9afa-a7c7ea49927d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = destroy vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7912024-05-16T19:49:18.347ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 202 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 0f457bc7-414b-4570-ab5f-8b82ffa091e7
7922024-05-16T19:49:18.347ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 1567 file = phd-tests/tests/src/server_state_machine.rs line = 28 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_tests::server_state_machine
7932024-05-16T19:49:18.347ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 203 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
7942024-05-16T19:49:18.347ZINFOphd-runner: Starting test phd_tests::server_state_machine::instance_start_stop_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
7952024-05-16T19:49:18.347ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
7962024-05-16T19:49:18.347ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
7972024-05-16T19:49:18.347ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/server_state_machine.rs line = 12 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_tests::server_state_machine
7982024-05-16T19:49:18.347ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
7992024-05-16T19:49:18.348ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
8002024-05-16T19:49:18.348ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
8012024-05-16T19:49:18.348ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = list
8022024-05-16T19:49:18.367ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_start_stop_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
8032024-05-16T19:49:18.367ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-1d935b67-1732-4233-b16f-9f1a4ca50f34"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = snapshot
8042024-05-16T19:49:18.388ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-1d935b67-1732-4233-b16f-9f1a4ca50f34", "phd-artifacts/phd-clone-c638f9b0-ed68-4f4f-b851-59d9e01e193d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = clone
8052024-05-16T19:49:18.410ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-c638f9b0-ed68-4f4f-b851-59d9e01e193d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = list
8062024-05-16T19:49:18.426ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_start_stop_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-c638f9b0-ed68-4f4f-b851-59d9e01e193d 0B 1.80T 801M /phd-artifacts/phd-clone-c638f9b0-ed68-4f4f-b851-59d9e01e193d\n target = phd_framework::zfs
8072024-05-16T19:49:18.426ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm
8082024-05-16T19:49:18.426ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::server_state_machine::instance_start_stop_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-c638f9b0-ed68-4f4f-b851-59d9e01e193d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = instance_ensure_running_test
8092024-05-16T19:49:18.426ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
8102024-05-16T19:49:18.426ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_ensure_running_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::server_state_machine::instance_start_stop_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
8112024-05-16T19:49:18.426ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::server_state_machine::instance_start_stop_test stderr_path = "/tmp/propolis-phd/instance_ensure_running_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_ensure_running_test.stdout.log" target = phd_framework::server_log_mode
8122024-05-16T19:49:18.436ZINFOphd-runner: [NEW - EVENT] Launched server with pid 957 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm::server
8132024-05-16T19:49:18.437ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm
8142024-05-16T19:49:18.437ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8152024-05-16T19:49:18.437ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8162024-05-16T19:49:19.106ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
8172024-05-16T19:49:19.107ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: d831ffec-307c-46d9-adfe-87382dec0d70, silo_id: dda6d102-adcc-40c1-8ff4-570e40f90634 }, name: "phd-vm-84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::server_state_machine::instance_start_stop_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-c638f9b0-ed68-4f4f-b851-59d9e01e193d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8182024-05-16T19:49:19.107ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 670 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8192024-05-16T19:49:19.107ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8202024-05-16T19:49:19.107ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8212024-05-16T19:49:19.108ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8222024-05-16T19:49:19.108ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8232024-05-16T19:49:19.108ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_start_stop_test state = Run target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8242024-05-16T19:49:19.109ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8252024-05-16T19:49:19.109ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8262024-05-16T19:49:19.109ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 598 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8272024-05-16T19:49:19.109ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8282024-05-16T19:49:19.109ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8292024-05-16T19:49:19.109ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8302024-05-16T19:49:19.633ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8312024-05-16T19:49:19.633ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8322024-05-16T19:49:19.634ZINFOphd-runner: [GET - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8332024-05-16T19:49:19.634ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 525 file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8342024-05-16T19:49:19.634ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8352024-05-16T19:49:19.634ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_start_stop_test state = Stop target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8362024-05-16T19:49:19.635ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8372024-05-16T19:49:19.635ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8382024-05-16T19:49:19.635ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 598 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8392024-05-16T19:49:19.635ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8402024-05-16T19:49:19.635ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8412024-05-16T19:49:19.635ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8422024-05-16T19:49:19.636ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
8432024-05-16T19:49:19.636ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 529 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
8442024-05-16T19:49:20.235ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8452024-05-16T19:49:20.235ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 449 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8462024-05-16T19:49:20.236ZINFOphd-runner: [GET - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8472024-05-16T19:49:20.236ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 601 file = phd-tests/framework/src/test_vm/mod.rs line = 592 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8482024-05-16T19:49:20.236ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8492024-05-16T19:49:20.236ZINFOphd-runner: test phd_tests::server_state_machine::instance_start_stop_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
8502024-05-16T19:49:20.237ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
8512024-05-16T19:49:20.237ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::server_state_machine::instance_start_stop_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8522024-05-16T19:49:20.367ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8532024-05-16T19:49:20.367ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-c638f9b0-ed68-4f4f-b851-59d9e01e193d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = destroy vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8542024-05-16T19:49:20.408ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8552024-05-16T19:49:20.408ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-1d935b67-1732-4233-b16f-9f1a4ca50f34"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = destroy vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8562024-05-16T19:49:20.434ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 197 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 84aa52b4-d2e5-49f9-9c00-eb5b83a7f2be
8572024-05-16T19:49:20.434ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 2086 file = phd-tests/tests/src/server_state_machine.rs line = 12 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_tests::server_state_machine
8582024-05-16T19:49:20.435ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 197 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
8592024-05-16T19:49:20.435ZINFOphd-runner: Starting test phd_tests::migrate::multiple_migrations file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
8602024-05-16T19:49:20.435ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
8612024-05-16T19:49:20.435ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
8622024-05-16T19:49:20.435ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 291 path = phd_tests::migrate::multiple_migrations target = phd_tests::migrate
8632024-05-16T19:49:20.435ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
8642024-05-16T19:49:20.435ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
8652024-05-16T19:49:20.435ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
8662024-05-16T19:49:20.435ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = list
8672024-05-16T19:49:20.453ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::multiple_migrations stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
8682024-05-16T19:49:20.454ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84535406-90ad-4248-ad5e-7482c28f1c43"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = snapshot
8692024-05-16T19:49:20.474ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84535406-90ad-4248-ad5e-7482c28f1c43", "phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = clone
8702024-05-16T19:49:20.497ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = list
8712024-05-16T19:49:20.513ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::multiple_migrations stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5 0B 1.80T 801M /phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5\n target = phd_framework::zfs
8722024-05-16T19:49:20.514ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
8732024-05-16T19:49:20.514ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::multiple_migrations spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = multiple_migrations_0
8742024-05-16T19:49:20.514ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
8752024-05-16T19:49:20.514ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/multiple_migrations_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::multiple_migrations server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
8762024-05-16T19:49:20.514ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::multiple_migrations stderr_path = "/tmp/propolis-phd/multiple_migrations_0.stderr.log" stdout_path = "/tmp/propolis-phd/multiple_migrations_0.stdout.log" target = phd_framework::server_log_mode
8772024-05-16T19:49:20.525ZINFOphd-runner: [NEW - EVENT] Launched server with pid 965 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm::server
8782024-05-16T19:49:20.525ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
8792024-05-16T19:49:20.525ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
8802024-05-16T19:49:20.525ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::multiple_migrations spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = multiple_migrations_1
8812024-05-16T19:49:20.525ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
8822024-05-16T19:49:20.526ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/multiple_migrations_1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::multiple_migrations server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
8832024-05-16T19:49:20.526ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::multiple_migrations stderr_path = "/tmp/propolis-phd/multiple_migrations_1.stderr.log" stdout_path = "/tmp/propolis-phd/multiple_migrations_1.stdout.log" target = phd_framework::server_log_mode
8842024-05-16T19:49:20.536ZINFOphd-runner: [NEW - EVENT] Launched server with pid 966 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm::server
8852024-05-16T19:49:20.537ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
8862024-05-16T19:49:20.537ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
8872024-05-16T19:49:20.537ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::multiple_migrations spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = multiple_migrations_2
8882024-05-16T19:49:20.537ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
8892024-05-16T19:49:20.537ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/multiple_migrations_2.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::multiple_migrations server_addr = 127.0.0.1:9004 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
8902024-05-16T19:49:20.537ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::multiple_migrations stderr_path = "/tmp/propolis-phd/multiple_migrations_2.stderr.log" stdout_path = "/tmp/propolis-phd/multiple_migrations_2.stdout.log" target = phd_framework::server_log_mode
8912024-05-16T19:49:20.547ZINFOphd-runner: [NEW - EVENT] Launched server with pid 967 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm::server
8922024-05-16T19:49:20.547ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
8932024-05-16T19:49:20.547ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
8942024-05-16T19:49:20.660ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
8952024-05-16T19:49:20.661ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 767afecc-dc66-4906-b897-1850a81a547f, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 6cea23b1-317f-4199-9d41-a2f219c9bce4, silo_id: a406223e-f370-4314-bfff-39809b9a1fa8 }, name: "phd-vm-767afecc-dc66-4906-b897-1850a81a547f", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::multiple_migrations self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
8962024-05-16T19:49:20.661ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 114 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
8972024-05-16T19:49:20.661ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
8982024-05-16T19:49:20.661ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::multiple_migrations state = Run target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
8992024-05-16T19:49:20.662ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9002024-05-16T19:49:20.662ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
9012024-05-16T19:49:20.662ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = 300s vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9022024-05-16T19:49:20.662ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::multiple_migrations step = WaitFor("localhost login: ") target = phd_framework::test_vm
9032024-05-16T19:49:20.662ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9042024-05-16T19:49:20.662ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = CallerTimeout vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9052024-05-16T19:49:24.878ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4216 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9062024-05-16T19:49:24.878ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::multiple_migrations step = WriteStr("root") target = phd_framework::test_vm
9072024-05-16T19:49:24.879ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::multiple_migrations step = WaitFor("localhost:~#") target = phd_framework::test_vm
9082024-05-16T19:49:24.879ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9092024-05-16T19:49:24.879ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = CallerTimeout vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9102024-05-16T19:49:24.900ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9112024-05-16T19:49:24.900ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
9122024-05-16T19:49:24.900ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4237 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
9132024-05-16T19:49:24.900ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9142024-05-16T19:49:24.900ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = f9888f27-f0f0-457f-837b-7233c7237c26 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a timeout_duration = 45s
9152024-05-16T19:49:24.900ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9162024-05-16T19:49:25.016ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 4ee71d14-c71b-439c-94e3-ea24813fde1a, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: baab3a9f-dcc4-45af-a452-b026f9de00db, silo_id: bbeb4f94-966b-47cd-9aca-49ed5829a8c0 }, name: "phd-vm-4ee71d14-c71b-439c-94e3-ea24813fde1a", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::multiple_migrations self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9172024-05-16T19:49:25.016ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 116 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9182024-05-16T19:49:25.016ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = f9888f27-f0f0-457f-837b-7233c7237c26 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9192024-05-16T19:49:28.682ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":7609}} target = phd_framework::serial
9202024-05-16T19:49:29.135ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9212024-05-16T19:49:29.135ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4118 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = f9888f27-f0f0-457f-837b-7233c7237c26 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9222024-05-16T19:49:29.135ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4235 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 767afecc-dc66-4906-b897-1850a81a547f target = phd_framework::test_vm target_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9232024-05-16T19:49:29.135ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9242024-05-16T19:49:29.135ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9252024-05-16T19:49:31.523ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 2387 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9262024-05-16T19:49:31.523ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9272024-05-16T19:49:31.523ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9282024-05-16T19:49:31.555ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 31 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9292024-05-16T19:49:31.555ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9302024-05-16T19:49:31.555ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9002 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = bba182f5-6601-44d9-a566-fd09c53a065d path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152 timeout_duration = 45s
9312024-05-16T19:49:31.555ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152 vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9322024-05-16T19:49:31.668ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 0d16b301-237e-44c3-93fb-1b9c2ddf3152, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: dfe66fea-1920-4d3d-8a59-269c50c4ee61, silo_id: d73ad60c-18db-4644-8a32-b65a65f19ed2 }, name: "phd-vm-0d16b301-237e-44c3-93fb-1b9c2ddf3152", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::multiple_migrations self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152 vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9332024-05-16T19:49:31.668ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 112 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152 vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9342024-05-16T19:49:31.668ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = bba182f5-6601-44d9-a566-fd09c53a065d path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9352024-05-16T19:49:35.348ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9004","from_start":7657}} target = phd_framework::serial
9362024-05-16T19:49:35.939ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9372024-05-16T19:49:35.939ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4270 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = bba182f5-6601-44d9-a566-fd09c53a065d path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9382024-05-16T19:49:35.939ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4383 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a target = phd_framework::test_vm target_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9392024-05-16T19:49:35.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9402024-05-16T19:49:35.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9412024-05-16T19:49:35.950ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9422024-05-16T19:49:35.950ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9432024-05-16T19:49:35.950ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9442024-05-16T19:49:35.972ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9452024-05-16T19:49:35.973ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9462024-05-16T19:49:35.973ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9472024-05-16T19:49:35.973ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9482024-05-16T19:49:35.973ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
9492024-05-16T19:49:35.973ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 15313 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
9502024-05-16T19:49:35.973ZINFOphd-runner: test phd_tests::migrate::multiple_migrations ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
9512024-05-16T19:49:35.973ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
9522024-05-16T19:49:35.973ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9532024-05-16T19:49:35.974ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::multiple_migrations self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9542024-05-16T19:49:35.974ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::multiple_migrations self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9552024-05-16T19:49:36.105ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 131 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 767afecc-dc66-4906-b897-1850a81a547f
9562024-05-16T19:49:36.106ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::multiple_migrations self.address = 127.0.0.1:9004 target = phd_framework::test_vm::server vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9572024-05-16T19:49:36.220ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 246 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 4ee71d14-c71b-439c-94e3-ea24813fde1a
9582024-05-16T19:49:36.319ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9592024-05-16T19:49:36.319ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-9b96799f-149c-4854-8e57-699b82fe83b5"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = destroy vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9602024-05-16T19:49:36.354ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9612024-05-16T19:49:36.354ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-84535406-90ad-4248-ad5e-7482c28f1c43"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = destroy vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9622024-05-16T19:49:36.383ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 410 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = 0d16b301-237e-44c3-93fb-1b9c2ddf3152
9632024-05-16T19:49:36.383ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 15948 file = phd-tests/tests/src/migrate.rs line = 291 path = phd_tests::migrate::multiple_migrations target = phd_tests::migrate
9642024-05-16T19:49:36.383ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 410 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
9652024-05-16T19:49:36.383ZINFOphd-runner: Starting test phd_tests::migrate::incompatible_vms file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
9662024-05-16T19:49:36.383ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
9672024-05-16T19:49:36.383ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
9682024-05-16T19:49:36.384ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 248 path = phd_tests::migrate::incompatible_vms target = phd_tests::migrate
9692024-05-16T19:49:36.384ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
9702024-05-16T19:49:36.384ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
9712024-05-16T19:49:36.384ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
9722024-05-16T19:49:36.384ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
9732024-05-16T19:49:36.406ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 801M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
9742024-05-16T19:49:36.406ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-4f5dee3c-6617-4af4-9696-505931406945"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = snapshot
9752024-05-16T19:49:36.425ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-4f5dee3c-6617-4af4-9696-505931406945", "phd-artifacts/phd-clone-68869cb4-994b-417e-aeef-1c00ae268e0a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = clone
9762024-05-16T19:49:36.448ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-68869cb4-994b-417e-aeef-1c00ae268e0a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
9772024-05-16T19:49:36.464ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-68869cb4-994b-417e-aeef-1c00ae268e0a 0B 1.80T 801M /phd-artifacts/phd-clone-68869cb4-994b-417e-aeef-1c00ae268e0a\n target = phd_framework::zfs
9782024-05-16T19:49:36.464ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
9792024-05-16T19:49:36.464ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::incompatible_vms spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-68869cb4-994b-417e-aeef-1c00ae268e0a/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_incompatible_source_0
9802024-05-16T19:49:36.465ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
9812024-05-16T19:49:36.465ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_incompatible_source_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::incompatible_vms server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
9822024-05-16T19:49:36.465ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::incompatible_vms stderr_path = "/tmp/propolis-phd/migration_incompatible_source_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_incompatible_source_0.stdout.log" target = phd_framework::server_log_mode
9832024-05-16T19:49:36.474ZINFOphd-runner: [NEW - EVENT] Launched server with pid 977 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm::server
9842024-05-16T19:49:36.474ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 9 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
9852024-05-16T19:49:36.474ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
9862024-05-16T19:49:36.475ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
9872024-05-16T19:49:37.289ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
9882024-05-16T19:49:37.290ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 8cc27898-ead8-4aae-bf91-6f9f6ed83146, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: c4aba9d5-60b6-41ed-ab04-7a42249f0271, silo_id: a1222e88-113c-4095-b224-cff57a75106b }, name: "phd-vm-8cc27898-ead8-4aae-bf91-6f9f6ed83146", vcpus: 4 }, state: Creating } line = 381 path = phd_tests::migrate::incompatible_vms self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-68869cb4-994b-417e-aeef-1c00ae268e0a/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
9892024-05-16T19:49:37.290ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 815 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
9902024-05-16T19:49:37.290ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
9912024-05-16T19:49:37.290ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::incompatible_vms state = Run target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
9922024-05-16T19:49:37.291ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
9932024-05-16T19:49:37.291ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
9942024-05-16T19:49:37.291ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
9952024-05-16T19:49:37.291ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
9962024-05-16T19:49:37.291ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
9972024-05-16T19:49:37.314ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
9982024-05-16T19:49:37.314ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-6d66b947-b198-4d4c-8946-bb050c2b8679"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = snapshot
9992024-05-16T19:49:37.342ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-6d66b947-b198-4d4c-8946-bb050c2b8679", "phd-artifacts/phd-clone-a2397047-bd03-4c8b-99ef-5b0251fc08bc"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = clone
10002024-05-16T19:49:37.364ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-a2397047-bd03-4c8b-99ef-5b0251fc08bc"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
10012024-05-16T19:49:37.380ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-a2397047-bd03-4c8b-99ef-5b0251fc08bc 0B 1.80T 801M /phd-artifacts/phd-clone-a2397047-bd03-4c8b-99ef-5b0251fc08bc\n target = phd_framework::zfs
10022024-05-16T19:49:37.381ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
10032024-05-16T19:49:37.381ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::incompatible_vms spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a2397047-bd03-4c8b-99ef-5b0251fc08bc/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 8, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_incompatible_target_1
10042024-05-16T19:49:37.381ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
10052024-05-16T19:49:37.381ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_incompatible_target_1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::incompatible_vms server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
10062024-05-16T19:49:37.381ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::incompatible_vms stderr_path = "/tmp/propolis-phd/migration_incompatible_target_1.stderr.log" stdout_path = "/tmp/propolis-phd/migration_incompatible_target_1.stdout.log" target = phd_framework::server_log_mode
10072024-05-16T19:49:37.392ZINFOphd-runner: [NEW - EVENT] Launched server with pid 982 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm::server
10082024-05-16T19:49:37.393ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
10092024-05-16T19:49:37.394ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10102024-05-16T19:49:37.394ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = fe910dd0-4c83-4fe2-8361-20a9b25a95db path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512 timeout_duration = 45s
10112024-05-16T19:49:37.394ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512 vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10122024-05-16T19:49:37.394ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512 vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10132024-05-16T19:49:37.990ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 70ff8d9f-fdc4-4167-b428-6bb08280b512, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: af5e9de0-7cfa-4d9a-bd4e-650c08e099c6, silo_id: d421b898-f4f4-4993-bf16-1ff885cd60b9 }, name: "phd-vm-70ff8d9f-fdc4-4167-b428-6bb08280b512", vcpus: 8 }, state: Failed } line = 381 path = phd_tests::migrate::incompatible_vms self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a2397047-bd03-4c8b-99ef-5b0251fc08bc/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 8, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512 vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10142024-05-16T19:49:37.990ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 596 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512 vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10152024-05-16T19:49:37.990ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = fe910dd0-4c83-4fe2-8361-20a9b25a95db path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10162024-05-16T19:49:37.991ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 537 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10172024-05-16T19:49:37.991ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = fe910dd0-4c83-4fe2-8361-20a9b25a95db path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10182024-05-16T19:49:37.991ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 597 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146 target = phd_framework::test_vm target_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10192024-05-16T19:49:37.992ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10202024-05-16T19:49:37.992ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
10212024-05-16T19:49:37.992ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
10222024-05-16T19:49:37.993ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
10232024-05-16T19:49:37.993ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
10242024-05-16T19:49:37.993ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
10252024-05-16T19:49:38.007ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10262024-05-16T19:49:38.007ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
10272024-05-16T19:49:38.016ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
10282024-05-16T19:49:38.016ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-d1a72a11-17d9-4e9a-a8b8-18788cbff4ef"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = snapshot
10292024-05-16T19:49:38.045ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-d1a72a11-17d9-4e9a-a8b8-18788cbff4ef", "phd-artifacts/phd-clone-7de8fc09-3e39-4d2d-91f6-46570dc9d541"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = clone
10302024-05-16T19:49:38.070ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-7de8fc09-3e39-4d2d-91f6-46570dc9d541"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
10312024-05-16T19:49:38.086ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-7de8fc09-3e39-4d2d-91f6-46570dc9d541 0B 1.80T 801M /phd-artifacts/phd-clone-7de8fc09-3e39-4d2d-91f6-46570dc9d541\n target = phd_framework::zfs
10322024-05-16T19:49:38.086ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
10332024-05-16T19:49:38.086ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::incompatible_vms spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-7de8fc09-3e39-4d2d-91f6-46570dc9d541/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_incompatible_source_1
10342024-05-16T19:49:38.086ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
10352024-05-16T19:49:38.087ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_incompatible_source_1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::incompatible_vms server_addr = 127.0.0.1:9004 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
10362024-05-16T19:49:38.087ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::incompatible_vms stderr_path = "/tmp/propolis-phd/migration_incompatible_source_1.stderr.log" stdout_path = "/tmp/propolis-phd/migration_incompatible_source_1.stdout.log" target = phd_framework::server_log_mode
10372024-05-16T19:49:38.097ZINFOphd-runner: [NEW - EVENT] Launched server with pid 987 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm::server
10382024-05-16T19:49:38.097ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
10392024-05-16T19:49:38.097ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10402024-05-16T19:49:38.099ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9004/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10412024-05-16T19:49:38.099ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
10422024-05-16T19:49:38.099ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 810 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
10432024-05-16T19:49:38.508ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::incompatible_vms self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
10442024-05-16T19:49:38.643ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
10452024-05-16T19:49:38.643ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-68869cb4-994b-417e-aeef-1c00ae268e0a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
10462024-05-16T19:49:38.680ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
10472024-05-16T19:49:38.680ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-4f5dee3c-6617-4af4-9696-505931406945"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
10482024-05-16T19:49:38.709ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 716 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = 8cc27898-ead8-4aae-bf91-6f9f6ed83146
10492024-05-16T19:49:38.710ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::incompatible_vms self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10502024-05-16T19:49:38.825ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
10512024-05-16T19:49:38.826ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 88ad0445-59e1-4e5e-b538-84d0648a667a, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: c7db41bf-66bf-4eae-a03a-25e82d520af6, silo_id: b3ec80a6-8ed7-405b-9848-197856789859 }, name: "phd-vm-88ad0445-59e1-4e5e-b538-84d0648a667a", vcpus: 4 }, state: Creating } line = 381 path = phd_tests::migrate::incompatible_vms self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-7de8fc09-3e39-4d2d-91f6-46570dc9d541/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10522024-05-16T19:49:38.826ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 728 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10532024-05-16T19:49:38.826ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10542024-05-16T19:49:38.826ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::incompatible_vms state = Run target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10552024-05-16T19:49:38.827ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10562024-05-16T19:49:38.827ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
10572024-05-16T19:49:38.827ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
10582024-05-16T19:49:38.827ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
10592024-05-16T19:49:38.827ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
10602024-05-16T19:49:38.845ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10612024-05-16T19:49:38.845ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-a2397047-bd03-4c8b-99ef-5b0251fc08bc"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10622024-05-16T19:49:38.857ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
10632024-05-16T19:49:38.857ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-4f44c89b-e4f0-47ee-9401-3088f144e32a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = snapshot
10642024-05-16T19:49:38.880ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10652024-05-16T19:49:38.880ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-6d66b947-b198-4d4c-8946-bb050c2b8679"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10662024-05-16T19:49:38.890ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-4f44c89b-e4f0-47ee-9401-3088f144e32a", "phd-artifacts/phd-clone-a212be9f-2365-422b-b737-ebb397d7d17d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = clone
10672024-05-16T19:49:38.907ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 914 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_target_1 vm_id = 70ff8d9f-fdc4-4167-b428-6bb08280b512
10682024-05-16T19:49:38.917ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-a212be9f-2365-422b-b737-ebb397d7d17d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
10692024-05-16T19:49:38.934ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-a212be9f-2365-422b-b737-ebb397d7d17d 0B 1.80T 801M /phd-artifacts/phd-clone-a212be9f-2365-422b-b737-ebb397d7d17d\n target = phd_framework::zfs
10702024-05-16T19:49:38.935ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
10712024-05-16T19:49:38.935ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::incompatible_vms spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a212be9f-2365-422b-b737-ebb397d7d17d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 1024 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_incompatible_target_2
10722024-05-16T19:49:38.935ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
10732024-05-16T19:49:38.935ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_incompatible_target_2.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::incompatible_vms server_addr = 127.0.0.1:9006 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
10742024-05-16T19:49:38.935ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::incompatible_vms stderr_path = "/tmp/propolis-phd/migration_incompatible_target_2.stderr.log" stdout_path = "/tmp/propolis-phd/migration_incompatible_target_2.stdout.log" target = phd_framework::server_log_mode
10752024-05-16T19:49:38.945ZINFOphd-runner: [NEW - EVENT] Launched server with pid 998 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm::server
10762024-05-16T19:49:38.945ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
10772024-05-16T19:49:38.945ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10782024-05-16T19:49:38.945ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9004 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 0043ec5a-3cc9-4b35-ad6e-6da89a928c93 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd timeout_duration = 90s
10792024-05-16T19:49:38.945ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10802024-05-16T19:49:38.946ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9006/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10812024-05-16T19:49:39.388ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: c4063763-19fd-43a1-a4c5-ede7162344dd, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 7d5dffd9-7fbc-4462-b863-beb5c58f123b, silo_id: d6e7d4e2-fe82-4366-bac6-7182f18da461 }, name: "phd-vm-c4063763-19fd-43a1-a4c5-ede7162344dd", vcpus: 2 }, state: Failed } line = 381 path = phd_tests::migrate::incompatible_vms self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a212be9f-2365-422b-b737-ebb397d7d17d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 1024 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10822024-05-16T19:49:39.388ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 442 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10832024-05-16T19:49:39.388ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 0043ec5a-3cc9-4b35-ad6e-6da89a928c93 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10842024-05-16T19:49:39.389ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 537 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10852024-05-16T19:49:39.389ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 0043ec5a-3cc9-4b35-ad6e-6da89a928c93 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10862024-05-16T19:49:39.389ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 443 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = 88ad0445-59e1-4e5e-b538-84d0648a667a target = phd_framework::test_vm target_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10872024-05-16T19:49:39.390ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10882024-05-16T19:49:39.390ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10892024-05-16T19:49:39.390ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
10902024-05-16T19:49:39.390ZINFOphd-runner: test phd_tests::migrate::incompatible_vms ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
10912024-05-16T19:49:39.391ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 565 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
10922024-05-16T19:49:39.391ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
10932024-05-16T19:49:39.391ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10942024-05-16T19:49:39.392ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
10952024-05-16T19:49:39.936ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::incompatible_vms self.address = 127.0.0.1:9004 target = phd_framework::test_vm::server vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10962024-05-16T19:49:40.066ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10972024-05-16T19:49:40.067ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-7de8fc09-3e39-4d2d-91f6-46570dc9d541"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10982024-05-16T19:49:40.102ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
10992024-05-16T19:49:40.102ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-d1a72a11-17d9-4e9a-a8b8-18788cbff4ef"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
11002024-05-16T19:49:40.131ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 740 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = 88ad0445-59e1-4e5e-b538-84d0648a667a
11012024-05-16T19:49:40.133ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::incompatible_vms self.address = 127.0.0.1:9006 target = phd_framework::test_vm::server vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
11022024-05-16T19:49:40.344ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
11032024-05-16T19:49:40.344ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-a212be9f-2365-422b-b737-ebb397d7d17d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
11042024-05-16T19:49:40.375ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
11052024-05-16T19:49:40.375ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-4f44c89b-e4f0-47ee-9401-3088f144e32a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
11062024-05-16T19:49:40.396ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 1005 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_target_2 vm_id = c4063763-19fd-43a1-a4c5-ede7162344dd
11072024-05-16T19:49:40.396ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 4012 file = phd-tests/tests/src/migrate.rs line = 248 path = phd_tests::migrate::incompatible_vms target = phd_tests::migrate
11082024-05-16T19:49:40.396ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 1005 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
11092024-05-16T19:49:40.397ZINFOphd-runner: Starting test phd_tests::migrate::serial_history file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
11102024-05-16T19:49:40.397ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
11112024-05-16T19:49:40.397ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
11122024-05-16T19:49:40.397ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 18 path = phd_tests::migrate::serial_history target = phd_tests::migrate
11132024-05-16T19:49:40.397ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
11142024-05-16T19:49:40.397ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
11152024-05-16T19:49:40.397ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
11162024-05-16T19:49:40.397ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = list
11172024-05-16T19:49:40.412ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::serial_history stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
11182024-05-16T19:49:40.413ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-3530a175-5e3e-4518-bfdc-e1b7566ccd36"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = snapshot
11192024-05-16T19:49:40.434ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-3530a175-5e3e-4518-bfdc-e1b7566ccd36", "phd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = clone
11202024-05-16T19:49:40.455ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = list
11212024-05-16T19:49:40.471ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::serial_history stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e 0B 1.80T 801M /phd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e\n target = phd_framework::zfs
11222024-05-16T19:49:40.472ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
11232024-05-16T19:49:40.472ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::serial_history spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_serial_history
11242024-05-16T19:49:40.472ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
11252024-05-16T19:49:40.472ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_serial_history.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::serial_history server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
11262024-05-16T19:49:40.472ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::serial_history stderr_path = "/tmp/propolis-phd/migration_serial_history.stderr.log" stdout_path = "/tmp/propolis-phd/migration_serial_history.stdout.log" target = phd_framework::server_log_mode
11272024-05-16T19:49:40.483ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1009 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::serial_history target = phd_framework::test_vm::server
11282024-05-16T19:49:40.483ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
11292024-05-16T19:49:40.483ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11302024-05-16T19:49:40.484ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11312024-05-16T19:49:41.035ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
11322024-05-16T19:49:41.036ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 52854470-1d37-4321-b848-49a98e35f1da, silo_id: 8b152792-e74b-4242-bf3f-345c8cc07e8a }, name: "phd-vm-9b0074b1-9fde-4bc5-aa8f-0058fbcd0181", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::serial_history self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11332024-05-16T19:49:41.036ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 552 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11342024-05-16T19:49:41.036ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11352024-05-16T19:49:41.036ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::serial_history state = Run target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11362024-05-16T19:49:41.037ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11372024-05-16T19:49:41.037ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
11382024-05-16T19:49:41.037ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = 300s vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11392024-05-16T19:49:41.037ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::serial_history step = WaitFor("localhost login: ") target = phd_framework::test_vm
11402024-05-16T19:49:41.037ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11412024-05-16T19:49:41.037ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11422024-05-16T19:49:45.296ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4258 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11432024-05-16T19:49:45.296ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::serial_history step = WriteStr("root") target = phd_framework::test_vm
11442024-05-16T19:49:45.296ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::serial_history step = WaitFor("localhost:~#") target = phd_framework::test_vm
11452024-05-16T19:49:45.296ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11462024-05-16T19:49:45.296ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11472024-05-16T19:49:45.317ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11482024-05-16T19:49:45.317ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
11492024-05-16T19:49:45.317ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4279 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
11502024-05-16T19:49:45.317ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11512024-05-16T19:49:45.317ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11522024-05-16T19:49:45.326ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11532024-05-16T19:49:45.326ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11542024-05-16T19:49:45.326ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11552024-05-16T19:49:45.357ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 30 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11562024-05-16T19:49:45.362ZINFOphd-runner: [TEST - EVENT] migrating to new Propolis artifact for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 74 path = phd_tests::migrate::serial_history propolis_artifact = __DEFAULT_PROPOLIS target = phd_framework::lifecycle vm_name = migration_serial_history
11572024-05-16T19:49:45.362ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
11582024-05-16T19:49:45.362ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::serial_history spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_serial_history_lifecycle_0
11592024-05-16T19:49:45.362ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
11602024-05-16T19:49:45.362ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_serial_history_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::serial_history server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
11612024-05-16T19:49:45.362ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::serial_history stderr_path = "/tmp/propolis-phd/migration_serial_history_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_serial_history_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
11622024-05-16T19:49:45.379ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1010 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::serial_history target = phd_framework::test_vm::server
11632024-05-16T19:49:45.379ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 17 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
11642024-05-16T19:49:45.379ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11652024-05-16T19:49:45.379ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 35014a06-b764-40bd-bcb7-73508640cb39 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6 timeout_duration = 45s
11662024-05-16T19:49:45.379ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6 vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11672024-05-16T19:49:45.380ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6 vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11682024-05-16T19:49:45.984ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: c52efaaf-5c85-463b-b144-47f081bfaabd, silo_id: 119cdece-abda-433a-9a3c-9d814b3046d1 }, name: "phd-vm-55e5bff9-71a8-4343-bdc5-d59fdb61d9e6", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::serial_history self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6 vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11692024-05-16T19:49:45.984ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 604 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6 vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11702024-05-16T19:49:45.984ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 35014a06-b764-40bd-bcb7-73508640cb39 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11712024-05-16T19:49:49.652ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":7685}} target = phd_framework::serial
11722024-05-16T19:49:50.712ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11732024-05-16T19:49:50.712ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4727 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 35014a06-b764-40bd-bcb7-73508640cb39 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11742024-05-16T19:49:50.712ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 5332 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181 target = phd_framework::test_vm target_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11752024-05-16T19:49:50.714ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11762024-05-16T19:49:50.715ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::serial_history self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11772024-05-16T19:49:50.850ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 135 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = 9b0074b1-9fde-4bc5-aa8f-0058fbcd0181
11782024-05-16T19:49:50.852ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11792024-05-16T19:49:50.853ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
11802024-05-16T19:49:50.853ZINFOphd-runner: test phd_tests::migrate::serial_history ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
11812024-05-16T19:49:50.853ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 9817 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
11822024-05-16T19:49:50.853ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
11832024-05-16T19:49:50.854ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11842024-05-16T19:49:51.470ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::serial_history self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11852024-05-16T19:49:51.601ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::serial_history target = phd_framework::zfs vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11862024-05-16T19:49:51.601ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-197fd0dd-2a73-4862-90f8-2a037354979e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = destroy vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11872024-05-16T19:49:51.634ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::serial_history target = phd_framework::zfs vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11882024-05-16T19:49:51.634ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-3530a175-5e3e-4518-bfdc-e1b7566ccd36"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = destroy vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11892024-05-16T19:49:51.657ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 804 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history_lifecycle_0 vm_id = 55e5bff9-71a8-4343-bdc5-d59fdb61d9e6
11902024-05-16T19:49:51.658ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 11260 file = phd-tests/tests/src/migrate.rs line = 18 path = phd_tests::migrate::serial_history target = phd_tests::migrate
11912024-05-16T19:49:51.658ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 804 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
11922024-05-16T19:49:51.658ZINFOphd-runner: Starting test phd_tests::migrate::smoke_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
11932024-05-16T19:49:51.658ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
11942024-05-16T19:49:51.658ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
11952024-05-16T19:49:51.658ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 13 path = phd_tests::migrate::smoke_test target = phd_tests::migrate
11962024-05-16T19:49:51.658ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
11972024-05-16T19:49:51.658ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
11982024-05-16T19:49:51.658ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
11992024-05-16T19:49:51.658ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = list
12002024-05-16T19:49:51.676ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::smoke_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
12012024-05-16T19:49:51.676ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-f2ec9297-d092-4ab8-ba55-6861e102d08f"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = snapshot
12022024-05-16T19:49:51.696ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-f2ec9297-d092-4ab8-ba55-6861e102d08f", "phd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = clone
12032024-05-16T19:49:51.716ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = list
12042024-05-16T19:49:51.733ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::smoke_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b 0B 1.80T 801M /phd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b\n target = phd_framework::zfs
12052024-05-16T19:49:51.734ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
12062024-05-16T19:49:51.734ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::smoke_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_smoke
12072024-05-16T19:49:51.734ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
12082024-05-16T19:49:51.734ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_smoke.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::smoke_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
12092024-05-16T19:49:51.734ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::smoke_test stderr_path = "/tmp/propolis-phd/migration_smoke.stderr.log" stdout_path = "/tmp/propolis-phd/migration_smoke.stdout.log" target = phd_framework::server_log_mode
12102024-05-16T19:49:51.745ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1019 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm::server
12112024-05-16T19:49:51.746ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 12 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
12122024-05-16T19:49:51.746ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12132024-05-16T19:49:51.746ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12142024-05-16T19:49:52.600ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
12152024-05-16T19:49:52.601ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 4d8ff5e5-03b5-4f8c-91c7-b6dffa031623, silo_id: a920a32d-1a38-4655-8669-175769b9c010 }, name: "phd-vm-4279a7d8-23f3-42d2-9b86-967d5bb9f0ac", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::smoke_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12162024-05-16T19:49:52.601ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 855 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12172024-05-16T19:49:52.601ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12182024-05-16T19:49:52.601ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::smoke_test state = Run target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12192024-05-16T19:49:52.602ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12202024-05-16T19:49:52.602ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
12212024-05-16T19:49:52.602ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = 300s vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12222024-05-16T19:49:52.602ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::smoke_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
12232024-05-16T19:49:52.602ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12242024-05-16T19:49:52.602ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12252024-05-16T19:49:56.818ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4215 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12262024-05-16T19:49:56.818ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::smoke_test step = WriteStr("root") target = phd_framework::test_vm
12272024-05-16T19:49:56.818ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::smoke_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
12282024-05-16T19:49:56.818ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12292024-05-16T19:49:56.818ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12302024-05-16T19:49:56.838ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12312024-05-16T19:49:56.838ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
12322024-05-16T19:49:56.838ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4236 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
12332024-05-16T19:49:56.839ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12342024-05-16T19:49:56.839ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12352024-05-16T19:49:56.847ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 7 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12362024-05-16T19:49:56.847ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12372024-05-16T19:49:56.847ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12382024-05-16T19:49:56.878ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 31 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12392024-05-16T19:49:56.879ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12402024-05-16T19:49:56.879ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12412024-05-16T19:49:56.890ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12422024-05-16T19:49:56.890ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12432024-05-16T19:49:56.890ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12442024-05-16T19:49:56.911ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12452024-05-16T19:49:56.912ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12462024-05-16T19:49:56.912ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12472024-05-16T19:49:56.923ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12482024-05-16T19:49:56.923ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12492024-05-16T19:49:56.923ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12502024-05-16T19:49:56.945ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12512024-05-16T19:49:56.945ZINFOphd-runner: [TEST - EVENT] migrating to new Propolis artifact for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 74 path = phd_tests::migrate::smoke_test propolis_artifact = __DEFAULT_PROPOLIS target = phd_framework::lifecycle vm_name = migration_smoke
12522024-05-16T19:49:56.945ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
12532024-05-16T19:49:56.945ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::smoke_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migration_smoke_lifecycle_0
12542024-05-16T19:49:56.945ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
12552024-05-16T19:49:56.945ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_smoke_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::smoke_test server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
12562024-05-16T19:49:56.945ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::smoke_test stderr_path = "/tmp/propolis-phd/migration_smoke_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_smoke_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
12572024-05-16T19:49:56.963ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1020 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm::server
12582024-05-16T19:49:56.963ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 18 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
12592024-05-16T19:49:56.963ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12602024-05-16T19:49:56.963ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 0a2beb83-5580-4271-8ff9-6c0d83394c3b path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a timeout_duration = 45s
12612024-05-16T19:49:56.963ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12622024-05-16T19:49:56.964ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12632024-05-16T19:49:57.525ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 7bd314fb-80d1-4347-b0e0-ae6a8885f77a, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 0dbd3a15-9340-4769-8757-69949a5154f9, silo_id: 8837bcc5-c896-48af-821b-800fe400eb87 }, name: "phd-vm-7bd314fb-80d1-4347-b0e0-ae6a8885f77a", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::smoke_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12642024-05-16T19:49:57.526ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 562 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12652024-05-16T19:49:57.526ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 0a2beb83-5580-4271-8ff9-6c0d83394c3b path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12662024-05-16T19:50:01.202ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":7718}} target = phd_framework::serial
12672024-05-16T19:50:01.250ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12682024-05-16T19:50:01.250ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 3724 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 0a2beb83-5580-4271-8ff9-6c0d83394c3b path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12692024-05-16T19:50:01.250ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4286 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac target = phd_framework::test_vm target_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12702024-05-16T19:50:01.252ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12712024-05-16T19:50:01.252ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12722024-05-16T19:50:01.252ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12732024-05-16T19:50:01.252ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::smoke_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12742024-05-16T19:50:01.389ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 137 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = 4279a7d8-23f3-42d2-9b86-967d5bb9f0ac
12752024-05-16T19:50:01.390ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 137 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12762024-05-16T19:50:01.390ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12772024-05-16T19:50:01.390ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12782024-05-16T19:50:01.413ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12792024-05-16T19:50:01.413ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12802024-05-16T19:50:01.413ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
12812024-05-16T19:50:01.413ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 8812 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
12822024-05-16T19:50:01.413ZINFOphd-runner: test phd_tests::migrate::smoke_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
12832024-05-16T19:50:01.413ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
12842024-05-16T19:50:01.414ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12852024-05-16T19:50:01.897ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::smoke_test self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12862024-05-16T19:50:02.042ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::smoke_test target = phd_framework::zfs vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12872024-05-16T19:50:02.042ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-bd74882a-1768-467a-b4d7-5786aaf3850b"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = destroy vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12882024-05-16T19:50:02.077ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::smoke_test target = phd_framework::zfs vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12892024-05-16T19:50:02.077ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-f2ec9297-d092-4ab8-ba55-6861e102d08f"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = destroy vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12902024-05-16T19:50:02.105ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 692 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = 7bd314fb-80d1-4347-b0e0-ae6a8885f77a
12912024-05-16T19:50:02.105ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 10447 file = phd-tests/tests/src/migrate.rs line = 13 path = phd_tests::migrate::smoke_test target = phd_tests::migrate
12922024-05-16T19:50:02.105ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 692 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
12932024-05-16T19:50:02.105ZINFOphd-runner: Starting test phd_tests::migrate::running_process::export_failure file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
12942024-05-16T19:50:02.105ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
12952024-05-16T19:50:02.105ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
12962024-05-16T19:50:02.106ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 172 path = phd_tests::migrate::running_process::export_failure target = phd_tests::migrate::running_process
12972024-05-16T19:50:02.106ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
12982024-05-16T19:50:02.106ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
12992024-05-16T19:50:02.106ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
13002024-05-16T19:50:02.106ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = list
13012024-05-16T19:50:02.123ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::export_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 801M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
13022024-05-16T19:50:02.123ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-986fc44c-5869-4033-b5aa-36ca15086414"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = snapshot
13032024-05-16T19:50:02.144ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-986fc44c-5869-4033-b5aa-36ca15086414", "phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = clone
13042024-05-16T19:50:02.170ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = list
13052024-05-16T19:50:02.186ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::export_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131 0B 1.80T 801M /phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131\n target = phd_framework::zfs
13062024-05-16T19:50:02.186ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13072024-05-16T19:50:02.187ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::running_process::export_failure spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migrate_running_process::export_failure_source
13082024-05-16T19:50:02.187ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
13092024-05-16T19:50:02.187ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::export_failure_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::export_failure server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
13102024-05-16T19:50:02.187ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::export_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::export_failure_source.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::export_failure_source.stdout.log" target = phd_framework::server_log_mode
13112024-05-16T19:50:02.196ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1029 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm::server
13122024-05-16T19:50:02.196ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 9 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13132024-05-16T19:50:02.196ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13142024-05-16T19:50:02.196ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::running_process::export_failure spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migrate_running_process::export_failure_target1
13152024-05-16T19:50:02.196ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
13162024-05-16T19:50:02.196ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::export_failure server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
13172024-05-16T19:50:02.197ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::export_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target1.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target1.stdout.log" target = phd_framework::server_log_mode
13182024-05-16T19:50:02.207ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1030 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm::server
13192024-05-16T19:50:02.207ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13202024-05-16T19:50:02.207ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13212024-05-16T19:50:02.208ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::running_process::export_failure spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migrate_running_process::export_failure_target2
13222024-05-16T19:50:02.208ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
13232024-05-16T19:50:02.208ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target2.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::export_failure server_addr = 127.0.0.1:9004 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
13242024-05-16T19:50:02.208ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::export_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target2.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target2.stdout.log" target = phd_framework::server_log_mode
13252024-05-16T19:50:02.219ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1031 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm::server
13262024-05-16T19:50:02.220ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 12 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13272024-05-16T19:50:02.220ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13282024-05-16T19:50:02.334ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
13292024-05-16T19:50:02.335ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 410e94f3-73d4-44ae-9354-04a29992720e, silo_id: d4aacd3c-5703-4c99-911a-7f03420bf68e }, name: "phd-vm-5bdf1fa5-ead1-468a-865f-bf5bd49b1d19", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::running_process::export_failure self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13302024-05-16T19:50:02.335ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 114 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13312024-05-16T19:50:02.335ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13322024-05-16T19:50:02.335ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::export_failure state = Run target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13332024-05-16T19:50:02.335ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13342024-05-16T19:50:02.336ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13352024-05-16T19:50:02.336ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = 300s vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13362024-05-16T19:50:02.336ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::export_failure step = WaitFor("localhost login: ") target = phd_framework::test_vm
13372024-05-16T19:50:02.336ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13382024-05-16T19:50:02.336ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13392024-05-16T19:50:06.558ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4221 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13402024-05-16T19:50:06.558ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::export_failure step = WriteStr("root") target = phd_framework::test_vm
13412024-05-16T19:50:06.558ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::export_failure step = WaitFor("localhost:~#") target = phd_framework::test_vm
13422024-05-16T19:50:06.558ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13432024-05-16T19:50:06.558ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13442024-05-16T19:50:06.578ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13452024-05-16T19:50:06.578ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13462024-05-16T19:50:06.578ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4242 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
13472024-05-16T19:50:06.579ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13482024-05-16T19:50:06.579ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13492024-05-16T19:50:06.701ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 122 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13502024-05-16T19:50:06.701ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13512024-05-16T19:50:06.701ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13522024-05-16T19:50:06.704ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 2 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13532024-05-16T19:50:06.704ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13542024-05-16T19:50:06.704ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13552024-05-16T19:50:06.715ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13562024-05-16T19:50:06.715ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13572024-05-16T19:50:06.716ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13582024-05-16T19:50:06.737ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13592024-05-16T19:50:06.737ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13602024-05-16T19:50:06.737ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13612024-05-16T19:50:06.749ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13622024-05-16T19:50:06.749ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13632024-05-16T19:50:06.749ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13642024-05-16T19:50:07.056ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 306 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13652024-05-16T19:50:07.056ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13662024-05-16T19:50:07.056ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 9cc7fae3-9e59-4951-96bd-5cd1929e9a07 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9 timeout_duration = 45s
13672024-05-16T19:50:07.056ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9 vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13682024-05-16T19:50:07.172ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 9d24b5c4-a941-45d6-bb5b-31528cead1b9, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: d66d9f33-1a47-4d02-8c21-5b6d746e8863, silo_id: ad90cc87-b8b7-4ae4-89f6-10fefe61b80f }, name: "phd-vm-9d24b5c4-a941-45d6-bb5b-31528cead1b9", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::running_process::export_failure self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9 vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13692024-05-16T19:50:07.172ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 116 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9 vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13702024-05-16T19:50:07.173ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 9cc7fae3-9e59-4951-96bd-5cd1929e9a07 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13712024-05-16T19:50:12.876ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 537 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13722024-05-16T19:50:12.876ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 5703 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 9cc7fae3-9e59-4951-96bd-5cd1929e9a07 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13732024-05-16T19:50:12.877ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 5820 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13742024-05-16T19:50:12.877ZINFOphd-runner: [TEST - EVENT] first migration failed as expected error = live migration file = phd-tests/tests/src/migrate.rs line = 206 path = phd_tests::migrate::running_process::export_failure target = phd_tests::migrate::running_process
13752024-05-16T19:50:12.877ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f
13762024-05-16T19:50:12.877ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = d7a494a0-f0fc-4ce1-a108-6fe58fcb3938 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f timeout_duration = 45s
13772024-05-16T19:50:12.877ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13782024-05-16T19:50:12.997ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 124c89dd-f218-4c88-bc91-49607317b87f, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 74799940-0d72-4a12-98b2-5cf0f927aa49, silo_id: e55b23ab-568b-4d60-9fe7-d7560df0b660 }, name: "phd-vm-124c89dd-f218-4c88-bc91-49607317b87f", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::running_process::export_failure self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13792024-05-16T19:50:12.997ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 120 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13802024-05-16T19:50:12.997ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = d7a494a0-f0fc-4ce1-a108-6fe58fcb3938 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f
13812024-05-16T19:50:16.659ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9004","from_start":9375}} target = phd_framework::serial
13822024-05-16T19:50:17.152ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f
13832024-05-16T19:50:17.152ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4154 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = d7a494a0-f0fc-4ce1-a108-6fe58fcb3938 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f
13842024-05-16T19:50:17.152ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4275 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19 target = phd_framework::test_vm target_id = 124c89dd-f218-4c88-bc91-49607317b87f
13852024-05-16T19:50:17.152ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13862024-05-16T19:50:17.152ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13872024-05-16T19:50:17.197ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 44 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13882024-05-16T19:50:17.197ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13892024-05-16T19:50:17.197ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13902024-05-16T19:50:17.285ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 87 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13912024-05-16T19:50:17.285ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13922024-05-16T19:50:17.285ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
13932024-05-16T19:50:17.285ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
13942024-05-16T19:50:17.285ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
13952024-05-16T19:50:17.286ZINFOphd-runner: test phd_tests::migrate::running_process::export_failure ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
13962024-05-16T19:50:17.286ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 14951 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
13972024-05-16T19:50:17.286ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
13982024-05-16T19:50:17.286ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
13992024-05-16T19:50:17.286ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
14002024-05-16T19:50:17.286ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::export_failure self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
14012024-05-16T19:50:17.416ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 130 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = 5bdf1fa5-ead1-468a-865f-bf5bd49b1d19
14022024-05-16T19:50:17.606ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::export_failure self.address = 127.0.0.1:9004 target = phd_framework::test_vm::server vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
14032024-05-16T19:50:17.741ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 455 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = 124c89dd-f218-4c88-bc91-49607317b87f
14042024-05-16T19:50:17.833ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::export_failure self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
14052024-05-16T19:50:17.972ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
14062024-05-16T19:50:17.972ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-737a09f9-f466-4549-a797-ee0c0c7d2131"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
14072024-05-16T19:50:18.008ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
14082024-05-16T19:50:18.009ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-986fc44c-5869-4033-b5aa-36ca15086414"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
14092024-05-16T19:50:18.036ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 750 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target1 vm_id = 9d24b5c4-a941-45d6-bb5b-31528cead1b9
14102024-05-16T19:50:18.036ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 15930 file = phd-tests/tests/src/migrate.rs line = 172 path = phd_tests::migrate::running_process::export_failure target = phd_tests::migrate::running_process
14112024-05-16T19:50:18.036ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 750 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
14122024-05-16T19:50:18.036ZINFOphd-runner: Starting test phd_tests::migrate::running_process::import_failure file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
14132024-05-16T19:50:18.036ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
14142024-05-16T19:50:18.036ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
14152024-05-16T19:50:18.036ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 120 path = phd_tests::migrate::running_process::import_failure target = phd_tests::migrate::running_process
14162024-05-16T19:50:18.036ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
14172024-05-16T19:50:18.037ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
14182024-05-16T19:50:18.037ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
14192024-05-16T19:50:18.037ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = list
14202024-05-16T19:50:18.053ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::import_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
14212024-05-16T19:50:18.053ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-3f540fbc-c619-4a4c-b031-30ce998af424"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = snapshot
14222024-05-16T19:50:18.074ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-3f540fbc-c619-4a4c-b031-30ce998af424", "phd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = clone
14232024-05-16T19:50:18.097ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = list
14242024-05-16T19:50:18.114ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::import_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0 0B 1.80T 801M /phd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0\n target = phd_framework::zfs
14252024-05-16T19:50:18.115ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14262024-05-16T19:50:18.115ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::running_process::import_failure spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migrate_running_process::import_failure_source
14272024-05-16T19:50:18.115ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
14282024-05-16T19:50:18.115ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::import_failure_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::import_failure server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
14292024-05-16T19:50:18.115ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::import_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::import_failure_source.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::import_failure_source.stdout.log" target = phd_framework::server_log_mode
14302024-05-16T19:50:18.126ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1041 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm::server
14312024-05-16T19:50:18.126ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14322024-05-16T19:50:18.126ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
14332024-05-16T19:50:18.127ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
14342024-05-16T19:50:18.127ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
14352024-05-16T19:50:18.127ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = list
14362024-05-16T19:50:18.143ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::import_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 802M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
14372024-05-16T19:50:18.143ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-78d2b0ec-daa3-494d-b0c4-f34a63839ea5"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = snapshot
14382024-05-16T19:50:18.166ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-78d2b0ec-daa3-494d-b0c4-f34a63839ea5", "phd-artifacts/phd-clone-e4b75ee8-5f2a-4ecd-95bc-926f0cecc04e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = clone
14392024-05-16T19:50:18.188ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-e4b75ee8-5f2a-4ecd-95bc-926f0cecc04e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = list
14402024-05-16T19:50:18.203ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::import_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-e4b75ee8-5f2a-4ecd-95bc-926f0cecc04e 0B 1.80T 801M /phd-artifacts/phd-clone-e4b75ee8-5f2a-4ecd-95bc-926f0cecc04e\n target = phd_framework::zfs
14412024-05-16T19:50:18.204ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14422024-05-16T19:50:18.204ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::running_process::import_failure spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-e4b75ee8-5f2a-4ecd-95bc-926f0cecc04e/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migrate_running_process::import_failure_target1
14432024-05-16T19:50:18.204ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
14442024-05-16T19:50:18.204ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::import_failure server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
14452024-05-16T19:50:18.204ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::import_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target1.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target1.stdout.log" target = phd_framework::server_log_mode
14462024-05-16T19:50:18.215ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1046 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm::server
14472024-05-16T19:50:18.215ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14482024-05-16T19:50:18.215ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14492024-05-16T19:50:18.215ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::running_process::import_failure spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migrate_running_process::import_failure_target2
14502024-05-16T19:50:18.216ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
14512024-05-16T19:50:18.216ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target2.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::import_failure server_addr = 127.0.0.1:9004 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
14522024-05-16T19:50:18.216ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::import_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target2.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target2.stdout.log" target = phd_framework::server_log_mode
14532024-05-16T19:50:18.226ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1047 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm::server
14542024-05-16T19:50:18.227ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14552024-05-16T19:50:18.227ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14562024-05-16T19:50:18.346ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
14572024-05-16T19:50:18.347ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 12b14be1-6aca-4edd-9e29-3a3623212abd, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 083b01ec-008a-40c0-a2ed-f90303f65419, silo_id: d97911b4-6b9b-4b9c-bea8-2f580c500e98 }, name: "phd-vm-12b14be1-6aca-4edd-9e29-3a3623212abd", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::running_process::import_failure self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14582024-05-16T19:50:18.347ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 120 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14592024-05-16T19:50:18.347ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14602024-05-16T19:50:18.347ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::import_failure state = Run target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14612024-05-16T19:50:18.348ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14622024-05-16T19:50:18.348ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14632024-05-16T19:50:18.348ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = 300s vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14642024-05-16T19:50:18.348ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::import_failure step = WaitFor("localhost login: ") target = phd_framework::test_vm
14652024-05-16T19:50:18.348ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14662024-05-16T19:50:18.348ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14672024-05-16T19:50:22.545ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4196 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14682024-05-16T19:50:22.545ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::import_failure step = WriteStr("root") target = phd_framework::test_vm
14692024-05-16T19:50:22.546ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::import_failure step = WaitFor("localhost:~#") target = phd_framework::test_vm
14702024-05-16T19:50:22.546ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14712024-05-16T19:50:22.546ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14722024-05-16T19:50:22.566ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14732024-05-16T19:50:22.566ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14742024-05-16T19:50:22.566ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4217 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
14752024-05-16T19:50:22.566ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14762024-05-16T19:50:22.566ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14772024-05-16T19:50:22.688ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 121 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14782024-05-16T19:50:22.688ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14792024-05-16T19:50:22.688ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14802024-05-16T19:50:22.692ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14812024-05-16T19:50:22.693ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14822024-05-16T19:50:22.693ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14832024-05-16T19:50:22.703ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14842024-05-16T19:50:22.703ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14852024-05-16T19:50:22.703ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14862024-05-16T19:50:22.725ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14872024-05-16T19:50:22.725ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14882024-05-16T19:50:22.725ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14892024-05-16T19:50:22.736ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14902024-05-16T19:50:22.736ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14912024-05-16T19:50:22.736ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14922024-05-16T19:50:23.042ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 306 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
14932024-05-16T19:50:23.042ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
14942024-05-16T19:50:23.042ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 2ea0f800-1d2d-4746-a223-0e8f227853e9 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e timeout_duration = 45s
14952024-05-16T19:50:23.042ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
14962024-05-16T19:50:23.159ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: b64ae21a-7d7d-439b-9909-adae39a29ac0, silo_id: d5ea07f7-c161-4667-81b0-69def302823e }, name: "phd-vm-b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::running_process::import_failure self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-e4b75ee8-5f2a-4ecd-95bc-926f0cecc04e/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
14972024-05-16T19:50:23.159ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 116 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
14982024-05-16T19:50:23.159ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 2ea0f800-1d2d-4746-a223-0e8f227853e9 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
14992024-05-16T19:50:28.022ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 537 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15002024-05-16T19:50:28.023ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4863 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 2ea0f800-1d2d-4746-a223-0e8f227853e9 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15012024-05-16T19:50:28.023ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4980 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15022024-05-16T19:50:28.023ZINFOphd-runner: [TEST - EVENT] first migration failed as expected error = live migration file = phd-tests/tests/src/migrate.rs line = 162 path = phd_tests::migrate::running_process::import_failure target = phd_tests::migrate::running_process
15032024-05-16T19:50:28.023ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67
15042024-05-16T19:50:28.023ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 9b62ecce-b1d3-453e-84fd-eb0456e57a61 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67 timeout_duration = 45s
15052024-05-16T19:50:28.023ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67 vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15062024-05-16T19:50:28.130ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 934db82a-435a-446b-9617-3e47c8b01f67, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 78598a76-3c35-4779-a989-43e440cf7831, silo_id: 7bc47d17-b569-45a7-9cdf-673dd8919a90 }, name: "phd-vm-934db82a-435a-446b-9617-3e47c8b01f67", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::running_process::import_failure self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67 vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15072024-05-16T19:50:28.130ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 106 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67 vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15082024-05-16T19:50:28.130ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 9b62ecce-b1d3-453e-84fd-eb0456e57a61 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67
15092024-05-16T19:50:31.808ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9004","from_start":9375}} target = phd_framework::serial
15102024-05-16T19:50:35.410ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67
15112024-05-16T19:50:35.410ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 7280 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 9b62ecce-b1d3-453e-84fd-eb0456e57a61 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67
15122024-05-16T19:50:35.410ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 7387 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 12b14be1-6aca-4edd-9e29-3a3623212abd target = phd_framework::test_vm target_id = 934db82a-435a-446b-9617-3e47c8b01f67
15132024-05-16T19:50:35.410ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15142024-05-16T19:50:35.411ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15152024-05-16T19:50:35.421ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15162024-05-16T19:50:35.422ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15172024-05-16T19:50:35.422ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15182024-05-16T19:50:35.510ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 88 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15192024-05-16T19:50:35.510ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15202024-05-16T19:50:35.510ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15212024-05-16T19:50:35.510ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
15222024-05-16T19:50:35.511ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
15232024-05-16T19:50:35.511ZINFOphd-runner: test phd_tests::migrate::running_process::import_failure ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
15242024-05-16T19:50:35.511ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 17164 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
15252024-05-16T19:50:35.511ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
15262024-05-16T19:50:35.511ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15272024-05-16T19:50:35.512ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15282024-05-16T19:50:35.512ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::import_failure self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
15292024-05-16T19:50:35.646ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 135 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 12b14be1-6aca-4edd-9e29-3a3623212abd
15302024-05-16T19:50:36.074ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::import_failure self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15312024-05-16T19:50:36.205ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15322024-05-16T19:50:36.205ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-e4b75ee8-5f2a-4ecd-95bc-926f0cecc04e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15332024-05-16T19:50:36.231ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15342024-05-16T19:50:36.232ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-78d2b0ec-daa3-494d-b0c4-f34a63839ea5"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15352024-05-16T19:50:36.254ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 743 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target1 vm_id = b2c445ba-25bb-4bc9-8b9a-b94ecc9e112e
15362024-05-16T19:50:36.255ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::import_failure self.address = 127.0.0.1:9004 target = phd_framework::test_vm::server vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15372024-05-16T19:50:36.368ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15382024-05-16T19:50:36.368ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-6e3f34c0-2567-4dbd-86eb-4abff72ea8c0"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15392024-05-16T19:50:36.399ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15402024-05-16T19:50:36.399ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-3f540fbc-c619-4a4c-b031-30ce998af424"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15412024-05-16T19:50:36.422ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 911 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 934db82a-435a-446b-9617-3e47c8b01f67
15422024-05-16T19:50:36.422ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 18385 file = phd-tests/tests/src/migrate.rs line = 120 path = phd_tests::migrate::running_process::import_failure target = phd_tests::migrate::running_process
15432024-05-16T19:50:36.422ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 911 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
15442024-05-16T19:50:36.422ZINFOphd-runner: Starting test phd_tests::migrate::running_process::migrate_running_process file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
15452024-05-16T19:50:36.422ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
15462024-05-16T19:50:36.422ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
15472024-05-16T19:50:36.422ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 100 path = phd_tests::migrate::running_process::migrate_running_process target = phd_tests::migrate::running_process
15482024-05-16T19:50:36.422ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
15492024-05-16T19:50:36.423ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
15502024-05-16T19:50:36.423ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
15512024-05-16T19:50:36.423ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = list
15522024-05-16T19:50:36.438ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::migrate_running_process stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 801M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
15532024-05-16T19:50:36.438ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-85393bf8-86e9-41f0-8fa3-63daf34972a5"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = snapshot
15542024-05-16T19:50:36.458ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-85393bf8-86e9-41f0-8fa3-63daf34972a5", "phd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = clone
15552024-05-16T19:50:36.481ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = list
15562024-05-16T19:50:36.497ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::migrate_running_process stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d 0B 1.80T 801M /phd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d\n target = phd_framework::zfs
15572024-05-16T19:50:36.498ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
15582024-05-16T19:50:36.498ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::running_process::migrate_running_process spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migrate_running_process_source
15592024-05-16T19:50:36.498ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
15602024-05-16T19:50:36.499ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::migrate_running_process server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
15612024-05-16T19:50:36.499ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::migrate_running_process stderr_path = "/tmp/propolis-phd/migrate_running_process_source.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process_source.stdout.log" target = phd_framework::server_log_mode
15622024-05-16T19:50:36.509ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1059 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm::server
15632024-05-16T19:50:36.510ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
15642024-05-16T19:50:36.510ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
15652024-05-16T19:50:36.510ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::migrate::running_process::migrate_running_process spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = migrate_running_process_target
15662024-05-16T19:50:36.510ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
15672024-05-16T19:50:36.510ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process_target.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::migrate_running_process server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
15682024-05-16T19:50:36.510ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::migrate_running_process stderr_path = "/tmp/propolis-phd/migrate_running_process_target.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process_target.stdout.log" target = phd_framework::server_log_mode
15692024-05-16T19:50:36.520ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1060 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm::server
15702024-05-16T19:50:36.520ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
15712024-05-16T19:50:36.521ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15722024-05-16T19:50:36.521ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15732024-05-16T19:50:37.130ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
15742024-05-16T19:50:37.131ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 92409fcf-de37-4553-9184-6c650fdab75e, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 9aac6ef7-4c09-4091-8df5-08f1a4a00e80, silo_id: 710f83dc-b3dc-4f05-b5f0-b869b245a6f7 }, name: "phd-vm-92409fcf-de37-4553-9184-6c650fdab75e", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::migrate::running_process::migrate_running_process self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15752024-05-16T19:50:37.131ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 610 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15762024-05-16T19:50:37.131ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15772024-05-16T19:50:37.131ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::migrate_running_process state = Run target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15782024-05-16T19:50:37.132ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15792024-05-16T19:50:37.132ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
15802024-05-16T19:50:37.132ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = 300s vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15812024-05-16T19:50:37.132ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::migrate_running_process step = WaitFor("localhost login: ") target = phd_framework::test_vm
15822024-05-16T19:50:37.132ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15832024-05-16T19:50:37.132ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15842024-05-16T19:50:41.355ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4223 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15852024-05-16T19:50:41.355ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::migrate_running_process step = WriteStr("root") target = phd_framework::test_vm
15862024-05-16T19:50:41.355ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::migrate::running_process::migrate_running_process step = WaitFor("localhost:~#") target = phd_framework::test_vm
15872024-05-16T19:50:41.356ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15882024-05-16T19:50:41.356ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15892024-05-16T19:50:41.376ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15902024-05-16T19:50:41.377ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
15912024-05-16T19:50:41.377ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4244 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
15922024-05-16T19:50:41.377ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15932024-05-16T19:50:41.377ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15942024-05-16T19:50:41.498ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 121 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15952024-05-16T19:50:41.498ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15962024-05-16T19:50:41.498ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15972024-05-16T19:50:41.502ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 3 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15982024-05-16T19:50:41.502ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
15992024-05-16T19:50:41.502ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16002024-05-16T19:50:41.512ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16012024-05-16T19:50:41.512ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16022024-05-16T19:50:41.513ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16032024-05-16T19:50:41.535ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16042024-05-16T19:50:41.535ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16052024-05-16T19:50:41.535ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16062024-05-16T19:50:41.546ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16072024-05-16T19:50:41.546ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16082024-05-16T19:50:41.546ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16092024-05-16T19:50:41.857ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 311 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16102024-05-16T19:50:41.857ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16112024-05-16T19:50:41.858ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 84cfd583-63a7-443c-a15b-3a073649b04a path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec timeout_duration = 45s
16122024-05-16T19:50:41.858ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16132024-05-16T19:50:41.975ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 1dda1965-d9d1-4b54-a510-954cdad68fec, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: b871e367-3a28-4f22-a0c0-c4f003f94efa, silo_id: 5d76a1eb-80ab-492b-9e07-c3313c9dcd31 }, name: "phd-vm-1dda1965-d9d1-4b54-a510-954cdad68fec", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::migrate::running_process::migrate_running_process self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16142024-05-16T19:50:41.975ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 117 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16152024-05-16T19:50:41.976ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 84cfd583-63a7-443c-a15b-3a073649b04a path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16162024-05-16T19:50:45.625ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":9375}} target = phd_framework::serial
16172024-05-16T19:50:45.789ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16182024-05-16T19:50:45.790ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 3813 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 84cfd583-63a7-443c-a15b-3a073649b04a path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16192024-05-16T19:50:45.790ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 3932 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = 92409fcf-de37-4553-9184-6c650fdab75e target = phd_framework::test_vm target_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16202024-05-16T19:50:45.790ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16212024-05-16T19:50:45.790ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16222024-05-16T19:50:46.533ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 743 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16232024-05-16T19:50:46.534ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16242024-05-16T19:50:46.534ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16252024-05-16T19:50:46.622ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 88 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16262024-05-16T19:50:46.622ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16272024-05-16T19:50:46.622ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16282024-05-16T19:50:46.623ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
16292024-05-16T19:50:46.623ZINFOphd-runner: test phd_tests::migrate::running_process::migrate_running_process ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
16302024-05-16T19:50:46.623ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 9492 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
16312024-05-16T19:50:46.623ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
16322024-05-16T19:50:46.623ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16332024-05-16T19:50:46.624ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::migrate_running_process self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16342024-05-16T19:50:46.758ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 135 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = 92409fcf-de37-4553-9184-6c650fdab75e
16352024-05-16T19:50:46.760ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::migrate_running_process self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16362024-05-16T19:50:46.896ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16372024-05-16T19:50:46.896ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-321ed948-1a60-4708-a77e-31a34cf2d14d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = destroy vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16382024-05-16T19:50:46.932ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16392024-05-16T19:50:46.932ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-85393bf8-86e9-41f0-8fa3-63daf34972a5"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = destroy vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16402024-05-16T19:50:46.955ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 332 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = 1dda1965-d9d1-4b54-a510-954cdad68fec
16412024-05-16T19:50:46.955ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 10532 file = phd-tests/tests/src/migrate.rs line = 100 path = phd_tests::migrate::running_process::migrate_running_process target = phd_tests::migrate::running_process
16422024-05-16T19:50:46.955ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 332 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
16432024-05-16T19:50:46.955ZINFOphd-runner: Starting test phd_tests::crucible::migrate::load_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
16442024-05-16T19:50:46.955ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
16452024-05-16T19:50:46.955ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
16462024-05-16T19:50:46.955ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/migrate.rs line = 39 path = phd_tests::crucible::migrate::load_test target = phd_tests::crucible::migrate
16472024-05-16T19:50:46.955ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
16482024-05-16T19:50:46.956ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
16492024-05-16T19:50:46.956ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/92ca9a205b0cbde1d1892db2b6cb7ff84eef850f31be5d4c9f1b6960ddbb1949/crucible-downstairs target = phd_framework::artifacts::store
16502024-05-16T19:50:46.956ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
16512024-05-16T19:50:46.957ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9000", "--encrypted", "--uuid", "cf1a2e3c-49cc-44e5-8b99-2a9f60b94418", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16522024-05-16T19:50:47.016ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::load_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:46.97590564Z","hostname":"sock","pid":1065}\n{"msg":"UUID: cf1a2e3c-49cc-44e5-8b99-2a9f60b94418","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:47.00860372Z","hostname":"sock","pid":1065}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:47.008618741Z","hostname":"sock","pid":1065}\n target = phd_framework::disk::crucible
16532024-05-16T19:50:47.016ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9001", "--encrypted", "--uuid", "cf1a2e3c-49cc-44e5-8b99-2a9f60b94418", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16542024-05-16T19:50:47.075ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::load_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:47.036402214Z","hostname":"sock","pid":1066}\n{"msg":"UUID: cf1a2e3c-49cc-44e5-8b99-2a9f60b94418","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:47.068149392Z","hostname":"sock","pid":1066}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:47.068162502Z","hostname":"sock","pid":1066}\n target = phd_framework::disk::crucible
16552024-05-16T19:50:47.075ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9002", "--encrypted", "--uuid", "cf1a2e3c-49cc-44e5-8b99-2a9f60b94418", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16562024-05-16T19:50:47.133ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::load_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:47.094376083Z","hostname":"sock","pid":1067}\n{"msg":"UUID: cf1a2e3c-49cc-44e5-8b99-2a9f60b94418","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:47.125951424Z","hostname":"sock","pid":1067}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:50:47.125966065Z","hostname":"sock","pid":1067}\n target = phd_framework::disk::crucible
16572024-05-16T19:50:47.133ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9000.stdout.log" target = phd_framework::server_log_mode
16582024-05-16T19:50:47.133ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16592024-05-16T19:50:47.133ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16602024-05-16T19:50:47.145ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9001.stdout.log" target = phd_framework::server_log_mode
16612024-05-16T19:50:47.145ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16622024-05-16T19:50:47.145ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16632024-05-16T19:50:47.156ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9002.stdout.log" target = phd_framework::server_log_mode
16642024-05-16T19:50:47.156ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16652024-05-16T19:50:47.156ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
16662024-05-16T19:50:47.167ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
16672024-05-16T19:50:47.167ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::crucible::migrate::load_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"cf1a2e3c-49cc-44e5-8b99-2a9f60b94418\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"e6c6f696-cc22-4520-a6b3-1354a3bd1b6c\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"7b76c1b5-65c1-48dc-aa36-399539fc178c\\",\\"key\\":\\"X8ysxx+Cj+ugJShqU9om02VZKpsts6Ysa2DpGP/k7Fc=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = crucible_load_test_source
16682024-05-16T19:50:47.167ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
16692024-05-16T19:50:47.167ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_load_test_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::migrate::load_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
16702024-05-16T19:50:47.167ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_load_test_source.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_load_test_source.stdout.log" target = phd_framework::server_log_mode
16712024-05-16T19:50:47.178ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1071 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm::server
16722024-05-16T19:50:47.179ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
16732024-05-16T19:50:47.179ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16742024-05-16T19:50:47.180ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16752024-05-16T19:50:47.939ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
16762024-05-16T19:50:47.940ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: a716dd41-3cac-4214-b0d9-ba02f4158f00, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: d7f77e90-84e0-46fd-8761-38c4c792b006, silo_id: 3aa0cbf3-0c48-449c-bd7d-e2a87783bc39 }, name: "phd-vm-a716dd41-3cac-4214-b0d9-ba02f4158f00", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::crucible::migrate::load_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"cf1a2e3c-49cc-44e5-8b99-2a9f60b94418\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"e6c6f696-cc22-4520-a6b3-1354a3bd1b6c\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"7b76c1b5-65c1-48dc-aa36-399539fc178c\\",\\"key\\":\\"X8ysxx+Cj+ugJShqU9om02VZKpsts6Ysa2DpGP/k7Fc=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16772024-05-16T19:50:47.940ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 760 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16782024-05-16T19:50:47.940ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16792024-05-16T19:50:47.940ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::migrate::load_test state = Run target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16802024-05-16T19:50:47.941ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16812024-05-16T19:50:47.941ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
16822024-05-16T19:50:47.941ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16832024-05-16T19:50:47.941ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::migrate::load_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
16842024-05-16T19:50:47.941ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16852024-05-16T19:50:47.941ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16862024-05-16T19:50:52.878ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4936 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16872024-05-16T19:50:52.878ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::migrate::load_test step = WriteStr("root") target = phd_framework::test_vm
16882024-05-16T19:50:52.878ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::migrate::load_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
16892024-05-16T19:50:52.878ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16902024-05-16T19:50:52.878ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16912024-05-16T19:50:52.899ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
16922024-05-16T19:50:52.899ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
16932024-05-16T19:50:52.899ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4957 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
16942024-05-16T19:50:52.899ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
16952024-05-16T19:50:52.899ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::crucible::migrate::load_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"cf1a2e3c-49cc-44e5-8b99-2a9f60b94418\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"f306969a-c835-4c45-a8ea-1b1e04c6d94c\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":2,\\"opts\\":{\\"id\\":\\"ebdb8dc6-672e-492e-a932-cec0668dac63\\",\\"key\\":\\"X8ysxx+Cj+ugJShqU9om02VZKpsts6Ysa2DpGP/k7Fc=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = crucible_load_test_target
16962024-05-16T19:50:52.899ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
16972024-05-16T19:50:52.899ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_load_test_target.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::migrate::load_test server_addr = 127.0.0.1:9005 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
16982024-05-16T19:50:52.899ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_load_test_target.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_load_test_target.stdout.log" target = phd_framework::server_log_mode
16992024-05-16T19:50:52.916ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1072 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm::server
17002024-05-16T19:50:52.916ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 17 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
17012024-05-16T19:50:52.916ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17022024-05-16T19:50:52.917ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17032024-05-16T19:50:52.929ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 12 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17042024-05-16T19:50:52.929ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17052024-05-16T19:50:52.929ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17062024-05-16T19:50:53.160ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 230 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17072024-05-16T19:50:53.160ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17082024-05-16T19:50:53.160ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17092024-05-16T19:50:53.171ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17102024-05-16T19:50:53.171ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17112024-05-16T19:50:53.171ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17122024-05-16T19:50:53.441ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 270 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17132024-05-16T19:50:53.441ZINFOphd-runner: [TEST - EVENT] Generated SHA256 checksum: 3786c9fdd97e3bc6ac1b4e6853b5df12d4ba5fed9b60415a8333fc9a97eccb14 file = phd-tests/tests/src/crucible/migrate.rs line = 72 path = phd_tests::crucible::migrate::load_test target = phd_tests::crucible::migrate
17142024-05-16T19:50:53.441ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17152024-05-16T19:50:53.441ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17162024-05-16T19:50:53.451ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17172024-05-16T19:50:53.452ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17182024-05-16T19:50:53.452ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17192024-05-16T19:50:53.474ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17202024-05-16T19:50:53.474ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17212024-05-16T19:50:53.474ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9003 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = d6a0f9bf-6628-45c2-a0c3-edb86e1200a8 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e timeout_duration = 45s
17222024-05-16T19:50:53.474ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17232024-05-16T19:50:53.602ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 45900fd6-43ee-4e26-93eb-b56bd7f8e60e, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 06330ab6-676e-4001-972b-912d0f1eb2be, silo_id: 1bc9ec99-3e5d-4445-8488-8bf733344116 }, name: "phd-vm-45900fd6-43ee-4e26-93eb-b56bd7f8e60e", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::crucible::migrate::load_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"cf1a2e3c-49cc-44e5-8b99-2a9f60b94418\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"f306969a-c835-4c45-a8ea-1b1e04c6d94c\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":2,\\"opts\\":{\\"id\\":\\"ebdb8dc6-672e-492e-a932-cec0668dac63\\",\\"key\\":\\"X8ysxx+Cj+ugJShqU9om02VZKpsts6Ysa2DpGP/k7Fc=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17242024-05-16T19:50:53.602ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 128 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17252024-05-16T19:50:53.603ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = d6a0f9bf-6628-45c2-a0c3-edb86e1200a8 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17262024-05-16T19:50:59.374ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9005","from_start":7920}} target = phd_framework::serial
17272024-05-16T19:51:02.235ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17282024-05-16T19:51:02.235ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 8632 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = d6a0f9bf-6628-45c2-a0c3-edb86e1200a8 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17292024-05-16T19:51:02.235ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 8761 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = a716dd41-3cac-4214-b0d9-ba02f4158f00 target = phd_framework::test_vm target_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17302024-05-16T19:51:02.235ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17312024-05-16T19:51:02.235ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17322024-05-16T19:51:02.247ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17332024-05-16T19:51:02.247ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17342024-05-16T19:51:02.247ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17352024-05-16T19:51:02.280ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 33 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17362024-05-16T19:51:02.280ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17372024-05-16T19:51:02.280ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17382024-05-16T19:51:02.292ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17392024-05-16T19:51:02.292ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17402024-05-16T19:51:02.292ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17412024-05-16T19:51:02.561ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 268 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17422024-05-16T19:51:02.561ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17432024-05-16T19:51:02.561ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17442024-05-16T19:51:02.561ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
17452024-05-16T19:51:02.561ZINFOphd-runner: test phd_tests::crucible::migrate::load_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
17462024-05-16T19:51:02.561ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 14621 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
17472024-05-16T19:51:02.561ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
17482024-05-16T19:51:02.562ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17492024-05-16T19:51:02.563ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::migrate::load_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17502024-05-16T19:51:02.700ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 139 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = a716dd41-3cac-4214-b0d9-ba02f4158f00
17512024-05-16T19:51:02.702ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::migrate::load_test self.address = 127.0.0.1:9005 target = phd_framework::test_vm::server vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17522024-05-16T19:51:02.841ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::load_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9000" } } target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17532024-05-16T19:51:02.852ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::load_test self.path = "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9000" target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17542024-05-16T19:51:02.863ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::load_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9001" } } target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17552024-05-16T19:51:02.875ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::load_test self.path = "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9001" target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17562024-05-16T19:51:02.885ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::load_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9002" } } target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17572024-05-16T19:51:02.894ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::load_test self.path = "/tmp/propolis-phd/cf1a2e3c-49cc-44e5-8b99-2a9f60b94418_9002" target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17582024-05-16T19:51:02.905ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 343 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 45900fd6-43ee-4e26-93eb-b56bd7f8e60e
17592024-05-16T19:51:02.905ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 15949 file = phd-tests/tests/src/crucible/migrate.rs line = 39 path = phd_tests::crucible::migrate::load_test target = phd_tests::crucible::migrate
17602024-05-16T19:51:02.905ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 343 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
17612024-05-16T19:51:02.905ZINFOphd-runner: Starting test phd_tests::crucible::migrate::smoke_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
17622024-05-16T19:51:02.905ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
17632024-05-16T19:51:02.905ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
17642024-05-16T19:51:02.905ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/migrate.rs line = 10 path = phd_tests::crucible::migrate::smoke_test target = phd_tests::crucible::migrate
17652024-05-16T19:51:02.906ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
17662024-05-16T19:51:02.906ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
17672024-05-16T19:51:02.906ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/92ca9a205b0cbde1d1892db2b6cb7ff84eef850f31be5d4c9f1b6960ddbb1949/crucible-downstairs target = phd_framework::artifacts::store
17682024-05-16T19:51:02.906ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
17692024-05-16T19:51:02.906ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9000", "--encrypted", "--uuid", "6877cffc-4d2c-46f7-9c1a-2a52a6db03ba", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17702024-05-16T19:51:02.974ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::smoke_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:02.932707982Z","hostname":"sock","pid":1075}\n{"msg":"UUID: 6877cffc-4d2c-46f7-9c1a-2a52a6db03ba","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:02.965891709Z","hostname":"sock","pid":1075}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:02.965904239Z","hostname":"sock","pid":1075}\n target = phd_framework::disk::crucible
17712024-05-16T19:51:02.974ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9001", "--encrypted", "--uuid", "6877cffc-4d2c-46f7-9c1a-2a52a6db03ba", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17722024-05-16T19:51:03.040ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::smoke_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:02.998671971Z","hostname":"sock","pid":1076}\n{"msg":"UUID: 6877cffc-4d2c-46f7-9c1a-2a52a6db03ba","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:03.032551621Z","hostname":"sock","pid":1076}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:03.032563422Z","hostname":"sock","pid":1076}\n target = phd_framework::disk::crucible
17732024-05-16T19:51:03.040ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9002", "--encrypted", "--uuid", "6877cffc-4d2c-46f7-9c1a-2a52a6db03ba", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17742024-05-16T19:51:03.099ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::smoke_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:03.059890469Z","hostname":"sock","pid":1077}\n{"msg":"UUID: 6877cffc-4d2c-46f7-9c1a-2a52a6db03ba","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:03.092510317Z","hostname":"sock","pid":1077}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-05-16T19:51:03.092520957Z","hostname":"sock","pid":1077}\n target = phd_framework::disk::crucible
17752024-05-16T19:51:03.100ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9000.stdout.log" target = phd_framework::server_log_mode
17762024-05-16T19:51:03.100ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17772024-05-16T19:51:03.100ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17782024-05-16T19:51:03.111ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9001.stdout.log" target = phd_framework::server_log_mode
17792024-05-16T19:51:03.111ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17802024-05-16T19:51:03.111ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17812024-05-16T19:51:03.120ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9002.stdout.log" target = phd_framework::server_log_mode
17822024-05-16T19:51:03.120ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17832024-05-16T19:51:03.120ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
17842024-05-16T19:51:03.131ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
17852024-05-16T19:51:03.131ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::crucible::migrate::smoke_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"6877cffc-4d2c-46f7-9c1a-2a52a6db03ba\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"b01725d4-0d04-4fac-b145-c586ebb5361c\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"07590498-c058-4aee-b06e-451966010579\\",\\"key\\":\\"gWS4i3m/Ly6PcPw5cKRq1gbbblnuUsHwwEgU2CoKylY=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = crucible_migrate_smoke_source
17862024-05-16T19:51:03.131ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
17872024-05-16T19:51:03.131ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_migrate_smoke_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::migrate::smoke_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
17882024-05-16T19:51:03.131ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_migrate_smoke_source.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_migrate_smoke_source.stdout.log" target = phd_framework::server_log_mode
17892024-05-16T19:51:03.142ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1081 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm::server
17902024-05-16T19:51:03.142ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
17912024-05-16T19:51:03.142ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
17922024-05-16T19:51:03.143ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
17932024-05-16T19:51:03.648ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
17942024-05-16T19:51:03.648ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 748ae527-3722-4f05-806f-4b36c3d7f74e, silo_id: feeda439-948c-4abf-88f9-3e469e2ebe76 }, name: "phd-vm-6a247fb2-4ee7-42d0-8fac-4c1cb902c76e", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::crucible::migrate::smoke_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"6877cffc-4d2c-46f7-9c1a-2a52a6db03ba\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"b01725d4-0d04-4fac-b145-c586ebb5361c\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"07590498-c058-4aee-b06e-451966010579\\",\\"key\\":\\"gWS4i3m/Ly6PcPw5cKRq1gbbblnuUsHwwEgU2CoKylY=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
17952024-05-16T19:51:03.649ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 506 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
17962024-05-16T19:51:03.649ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
17972024-05-16T19:51:03.649ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::migrate::smoke_test state = Run target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
17982024-05-16T19:51:03.649ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
17992024-05-16T19:51:03.649ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
18002024-05-16T19:51:03.650ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18012024-05-16T19:51:03.650ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::migrate::smoke_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
18022024-05-16T19:51:03.650ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18032024-05-16T19:51:03.650ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18042024-05-16T19:51:08.544ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4893 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18052024-05-16T19:51:08.544ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::migrate::smoke_test step = WriteStr("root") target = phd_framework::test_vm
18062024-05-16T19:51:08.544ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::crucible::migrate::smoke_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
18072024-05-16T19:51:08.544ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18082024-05-16T19:51:08.544ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18092024-05-16T19:51:08.565ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18102024-05-16T19:51:08.565ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
18112024-05-16T19:51:08.565ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4915 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
18122024-05-16T19:51:08.565ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18132024-05-16T19:51:08.565ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18142024-05-16T19:51:08.571ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18152024-05-16T19:51:08.571ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18162024-05-16T19:51:08.571ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18172024-05-16T19:51:08.603ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 31 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18182024-05-16T19:51:08.603ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18192024-05-16T19:51:08.603ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18202024-05-16T19:51:08.614ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18212024-05-16T19:51:08.614ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18222024-05-16T19:51:08.614ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18232024-05-16T19:51:08.636ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18242024-05-16T19:51:08.636ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18252024-05-16T19:51:08.636ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18262024-05-16T19:51:08.646ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18272024-05-16T19:51:08.646ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18282024-05-16T19:51:08.646ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18292024-05-16T19:51:08.679ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18302024-05-16T19:51:08.680ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
18312024-05-16T19:51:08.680ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::crucible::migrate::smoke_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"6877cffc-4d2c-46f7-9c1a-2a52a6db03ba\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"d0372d38-8712-42b7-9e4e-913beddda791\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":2,\\"opts\\":{\\"id\\":\\"cfe14a37-4dca-4443-9e66-b096a84eeb72\\",\\"key\\":\\"gWS4i3m/Ly6PcPw5cKRq1gbbblnuUsHwwEgU2CoKylY=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = crucible_migrate_smoke_target
18322024-05-16T19:51:08.680ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
18332024-05-16T19:51:08.680ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_migrate_smoke_target.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::migrate::smoke_test server_addr = 127.0.0.1:9005 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
18342024-05-16T19:51:08.680ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_migrate_smoke_target.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_migrate_smoke_target.stdout.log" target = phd_framework::server_log_mode
18352024-05-16T19:51:08.697ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1082 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm::server
18362024-05-16T19:51:08.697ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 17 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
18372024-05-16T19:51:08.697ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18382024-05-16T19:51:08.697ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9003 file = phd-tests/framework/src/test_vm/mod.rs line = 504 migration_id = 73dd14af-8bf7-4d17-8d07-9479faba15b9 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277 timeout_duration = 45s
18392024-05-16T19:51:08.697ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277 vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18402024-05-16T19:51:08.698ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9005/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277 vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18412024-05-16T19:51:09.310ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 349ff710-1261-4b5a-ac14-6f5abfa97277, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: c30b680a-e8d8-4f6f-a02f-1db57ca26cff, silo_id: 9f5194b3-764a-41a9-a664-f07f619a7ba4 }, name: "phd-vm-349ff710-1261-4b5a-ac14-6f5abfa97277", vcpus: 2 }, state: Migrating } line = 381 path = phd_tests::crucible::migrate::smoke_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": Crucible(CrucibleStorageBackend { readonly: false, request_json: "{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"6877cffc-4d2c-46f7-9c1a-2a52a6db03ba\\",\\"read_only_parent\\":{\\"type\\":\\"file\\",\\"block_size\\":512,\\"id\\":\\"d0372d38-8712-42b7-9e4e-913beddda791\\",\\"path\\":\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\"},\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":160,\\"gen\\":2,\\"opts\\":{\\"id\\":\\"cfe14a37-4dca-4443-9e66-b096a84eeb72\\",\\"key\\":\\"gWS4i3m/Ly6PcPw5cKRq1gbbblnuUsHwwEgU2CoKylY=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"127.0.0.1:9000\\",\\"127.0.0.1:9001\\",\\"127.0.0.1:9002\\"]}}]}" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277 vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18422024-05-16T19:51:09.310ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 612 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277 vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18432024-05-16T19:51:09.310ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 73dd14af-8bf7-4d17-8d07-9479faba15b9 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18442024-05-16T19:51:13.030ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9005","from_start":7718}} target = phd_framework::serial
18452024-05-16T19:51:14.076ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 533 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18462024-05-16T19:51:14.076ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4766 file = phd-tests/framework/src/test_vm/mod.rs line = 524 migration_id = 73dd14af-8bf7-4d17-8d07-9479faba15b9 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18472024-05-16T19:51:14.076ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 5379 file = phd-tests/framework/src/test_vm/mod.rs line = 471 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e target = phd_framework::test_vm target_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18482024-05-16T19:51:14.077ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18492024-05-16T19:51:14.077ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18502024-05-16T19:51:14.089ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18512024-05-16T19:51:14.089ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18522024-05-16T19:51:14.089ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18532024-05-16T19:51:14.122ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18542024-05-16T19:51:14.122ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18552024-05-16T19:51:14.122ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18562024-05-16T19:51:14.122ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
18572024-05-16T19:51:14.122ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 10474 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
18582024-05-16T19:51:14.122ZINFOphd-runner: test phd_tests::crucible::migrate::smoke_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
18592024-05-16T19:51:14.122ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
18602024-05-16T19:51:14.123ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18612024-05-16T19:51:14.123ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::migrate::smoke_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18622024-05-16T19:51:14.263ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 140 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = 6a247fb2-4ee7-42d0-8fac-4c1cb902c76e
18632024-05-16T19:51:14.264ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::migrate::smoke_test self.address = 127.0.0.1:9005 target = phd_framework::test_vm::server vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18642024-05-16T19:51:14.396ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::smoke_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9000" } } target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18652024-05-16T19:51:14.407ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::smoke_test self.path = "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9000" target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18662024-05-16T19:51:14.418ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::smoke_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9001" } } target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18672024-05-16T19:51:14.431ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::smoke_test self.path = "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9001" target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18682024-05-16T19:51:14.441ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::smoke_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9002" } } target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18692024-05-16T19:51:14.453ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::smoke_test self.path = "/tmp/propolis-phd/6877cffc-4d2c-46f7-9c1a-2a52a6db03ba_9002" target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18702024-05-16T19:51:14.463ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 341 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 349ff710-1261-4b5a-ac14-6f5abfa97277
18712024-05-16T19:51:14.463ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 11557 file = phd-tests/tests/src/crucible/migrate.rs line = 10 path = phd_tests::crucible::migrate::smoke_test target = phd_tests::crucible::migrate
18722024-05-16T19:51:14.463ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 341 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
18732024-05-16T19:51:14.464ZINFOphd-runner: Starting test phd_tests::hw::lspci_lifecycle_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
18742024-05-16T19:51:14.464ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
18752024-05-16T19:51:14.464ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
18762024-05-16T19:51:14.464ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/hw.rs line = 8 path = phd_tests::hw::lspci_lifecycle_test target = phd_tests::hw
18772024-05-16T19:51:14.464ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
18782024-05-16T19:51:14.464ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
18792024-05-16T19:51:14.464ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
18802024-05-16T19:51:14.464ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = list
18812024-05-16T19:51:14.488ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::hw::lspci_lifecycle_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 803M 1.80T 801M /phd-artifacts\n target = phd_framework::zfs
18822024-05-16T19:51:14.488ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84d777de-bca2-408c-90cf-c8b2331ff582"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = snapshot
18832024-05-16T19:51:14.513ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84d777de-bca2-408c-90cf-c8b2331ff582", "phd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = clone
18842024-05-16T19:51:14.539ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = list
18852024-05-16T19:51:14.555ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::hw::lspci_lifecycle_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8 0B 1.80T 801M /phd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8\n target = phd_framework::zfs
18862024-05-16T19:51:14.556ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
18872024-05-16T19:51:14.556ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::hw::lspci_lifecycle_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = lspci_lifecycle_test
18882024-05-16T19:51:14.556ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
18892024-05-16T19:51:14.556ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/lspci_lifecycle_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::hw::lspci_lifecycle_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
18902024-05-16T19:51:14.556ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::hw::lspci_lifecycle_test stderr_path = "/tmp/propolis-phd/lspci_lifecycle_test.stderr.log" stdout_path = "/tmp/propolis-phd/lspci_lifecycle_test.stdout.log" target = phd_framework::server_log_mode
18912024-05-16T19:51:14.567ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1089 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm::server
18922024-05-16T19:51:14.567ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
18932024-05-16T19:51:14.567ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
18942024-05-16T19:51:14.568ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
18952024-05-16T19:51:15.388ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
18962024-05-16T19:51:15.389ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 63ef274a-4e11-45ee-9493-51e4db208198, silo_id: 3182d21b-9100-432f-be80-d4fce53b212d }, name: "phd-vm-793f3e7b-a97e-40f3-aa8b-f60be5d9b83b", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::hw::lspci_lifecycle_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
18972024-05-16T19:51:15.389ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 821 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
18982024-05-16T19:51:15.389ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
18992024-05-16T19:51:15.389ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test state = Run target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19002024-05-16T19:51:15.390ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19012024-05-16T19:51:15.390ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
19022024-05-16T19:51:15.390ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = 300s vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19032024-05-16T19:51:15.390ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::hw::lspci_lifecycle_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
19042024-05-16T19:51:15.390ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19052024-05-16T19:51:15.390ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19062024-05-16T19:51:19.618ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4227 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19072024-05-16T19:51:19.618ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::hw::lspci_lifecycle_test step = WriteStr("root") target = phd_framework::test_vm
19082024-05-16T19:51:19.618ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::hw::lspci_lifecycle_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
19092024-05-16T19:51:19.618ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19102024-05-16T19:51:19.618ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19112024-05-16T19:51:19.639ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19122024-05-16T19:51:19.639ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
19132024-05-16T19:51:19.639ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4249 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
19142024-05-16T19:51:19.639ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19152024-05-16T19:51:19.639ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19162024-05-16T19:51:19.646ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 6 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19172024-05-16T19:51:19.646ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19182024-05-16T19:51:19.646ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19192024-05-16T19:51:19.678ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 31 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19202024-05-16T19:51:19.678ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19212024-05-16T19:51:19.678ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19222024-05-16T19:51:19.688ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19232024-05-16T19:51:19.689ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19242024-05-16T19:51:19.689ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19252024-05-16T19:51:19.721ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19262024-05-16T19:51:19.722ZINFOphd-runner: [TEST - EVENT] stopping and starting VM for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 58 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::lifecycle vm_name = lspci_lifecycle_test
19272024-05-16T19:51:19.722ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19282024-05-16T19:51:19.722ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test state = Stop target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19292024-05-16T19:51:19.723ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19302024-05-16T19:51:19.723ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
19312024-05-16T19:51:19.724ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 186 path = phd_tests::hw::lspci_lifecycle_test spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm_name = lspci_lifecycle_test_lifecycle_0
19322024-05-16T19:51:19.724ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
19332024-05-16T19:51:19.724ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::hw::lspci_lifecycle_test server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
19342024-05-16T19:51:19.724ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::hw::lspci_lifecycle_test stderr_path = "/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
19352024-05-16T19:51:19.741ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1090 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm::server
19362024-05-16T19:51:19.742ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 18 file = phd-tests/framework/src/test_vm/mod.rs line = 176 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
19372024-05-16T19:51:19.742ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19382024-05-16T19:51:19.742ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 325 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19392024-05-16T19:51:19.742ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
19402024-05-16T19:51:19.742ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4354 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
19412024-05-16T19:51:20.140ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
19422024-05-16T19:51:20.141ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 50de6d53-48f9-4d77-819c-aa94f7c58a22, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: a17e51ae-ad69-4d3a-8709-f44971136f2a, silo_id: 2da1a61a-4405-4cdb-87d6-e37f47b86bbd }, name: "phd-vm-50de6d53-48f9-4d77-819c-aa94f7c58a22", vcpus: 2 }, state: Creating } line = 381 path = phd_tests::hw::lspci_lifecycle_test self.spec.instance_spec = InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {"boot-disk": File(FileStorageBackend { path: "/phd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {"com1": SerialPort { num: Com1 }}, storage_devices: {"disk-device0": NvmeDisk(NvmeDisk { backend_name: "boot-disk", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } } target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19432024-05-16T19:51:20.141ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 399 file = phd-tests/framework/src/test_vm/mod.rs line = 272 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19442024-05-16T19:51:20.141ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19452024-05-16T19:51:20.141ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test state = Run target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19462024-05-16T19:51:20.142ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 437 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19472024-05-16T19:51:20.142ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
19482024-05-16T19:51:20.142ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 645 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = 300s vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19492024-05-16T19:51:20.142ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::hw::lspci_lifecycle_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
19502024-05-16T19:51:20.142ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19512024-05-16T19:51:20.142ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19522024-05-16T19:51:24.301ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4158 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19532024-05-16T19:51:24.301ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::hw::lspci_lifecycle_test step = WriteStr("root") target = phd_framework::test_vm
19542024-05-16T19:51:24.302ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 653 path = phd_tests::hw::lspci_lifecycle_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
19552024-05-16T19:51:24.302ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19562024-05-16T19:51:24.302ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19572024-05-16T19:51:24.322ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 20 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19582024-05-16T19:51:24.322ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 693 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
19592024-05-16T19:51:24.322ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4179 file = phd-tests/framework/src/test_vm/mod.rs line = 696 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
19602024-05-16T19:51:24.322ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19612024-05-16T19:51:24.322ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19622024-05-16T19:51:24.322ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19632024-05-16T19:51:24.323ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::hw::lspci_lifecycle_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19642024-05-16T19:51:24.464ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 141 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 793f3e7b-a97e-40f3-aa8b-f60be5d9b83b
19652024-05-16T19:51:24.466ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 143 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19662024-05-16T19:51:24.466ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19672024-05-16T19:51:24.466ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19682024-05-16T19:51:24.489ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19692024-05-16T19:51:24.489ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19702024-05-16T19:51:24.489ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19712024-05-16T19:51:24.500ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19722024-05-16T19:51:24.500ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19732024-05-16T19:51:24.500ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 718 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19742024-05-16T19:51:24.533ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 711 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19752024-05-16T19:51:24.533ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19762024-05-16T19:51:24.533ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
19772024-05-16T19:51:24.533ZINFOphd-runner: test phd_tests::hw::lspci_lifecycle_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
19782024-05-16T19:51:24.534ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4393 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
19792024-05-16T19:51:24.534ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
19802024-05-16T19:51:24.534ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 974 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19812024-05-16T19:51:25.046ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::hw::lspci_lifecycle_test self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19822024-05-16T19:51:25.186ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19832024-05-16T19:51:25.186ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-a455a748-5a4c-48e6-947c-cb0a9545b1f8"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = destroy vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19842024-05-16T19:51:25.220ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19852024-05-16T19:51:25.220ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-84d777de-bca2-408c-90cf-c8b2331ff582"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = destroy vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19862024-05-16T19:51:25.245ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 711 file = phd-tests/framework/src/test_vm/mod.rs line = 951 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 50de6d53-48f9-4d77-819c-aa94f7c58a22
19872024-05-16T19:51:25.245ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 10780 file = phd-tests/tests/src/hw.rs line = 8 path = phd_tests::hw::lspci_lifecycle_test target = phd_tests::hw
19882024-05-16T19:51:25.245ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 711 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
19892024-05-16T19:51:25.245ZINFOphd-runner: [EXECUTION_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 35 target = phd_runner::fixtures
19902024-05-16T19:51:25.245ZINFOphd-runner: [EXECUTION_CLEANUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 35 target = phd_runner::fixtures
1991 
1992 failures:
1993 phd_tests::migrate::from_base::migration_from_base_and_back
1994 phd_tests::migrate::from_base::serial_history
1995 phd_tests::migrate::from_base::can_migrate_from_base
1996 
1997 test result: FAILED. 18 passed; 3 failed; 1 skipped; 0 not run; finished in 304.02s
1998 
19992024-05-16T19:51:25.245ZDEBGphd-runner: phd_runner exit_code = 3 file = phd-tests/runner/src/main.rs line = 40 target = phd_runner