Max level shown:
12024-08-30T01:14:09.110ZINFOphd-runner: phd_runner file = phd-tests/runner/src/main.rs line = 35 runner_args = ProcessArgs { command: Run(RunOptions { propolis_server_cmd: "/work/phd-test/propolis-server", base_propolis_branch: None, base_propolis_commit: None, base_propolis_cmd: None, crucible_downstairs_cmd: None, crucible_downstairs_commit: Some(Auto), tmp_directory: "/tmp/propolis-phd", artifact_directory: Some("/phd-artifacts"), server_logging_mode: TmpFile, default_guest_cpus: 2, default_guest_memory_mib: 512, artifact_toml_path: "/work/phd-test/artifacts.toml", default_guest_artifact: "alpine", default_bootrom_artifact: "ovmf", include_filter: [], exclude_filter: ["phd_tests::migrate::from_base"], max_buildomat_wait_secs: 1200 }), disable_ansi: false, emit_bunyan: true } target = phd_runner
22024-08-30T01:14:09.112ZDEBGphd-runner: Created new artifact store from manifest file = phd-tests/framework/src/artifacts/store.rs line = 221 store = Store { local_dir: "/phd-artifacts", artifacts: {"alpine": Mutex { data: StoredArtifact { description: Artifact { filename: "alpine.iso", kind: GuestOs(Alpine), source: RemoteServer { sha256: "ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1" }, untar: None }, cached_path: None } }, "ovmf": Mutex { data: StoredArtifact { description: Artifact { filename: "OVMF_CODE.fd", kind: Bootrom, source: Buildomat(BuildomatArtifact { repo: Repo("oxidecomputer/edk2"), series: Series("image_debug"), commit: Commit("6d92acf0a22718dd4175d7c64dbcf7aaec3740bd"), sha256: "29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f" }), untar: None }, cached_path: None } }}, downloader: DownloadConfig { timeout: 600s, buildomat_backoff: ExponentialBackoff { current_interval: 1s, initial_interval: 1s, randomization_factor: 0.5, multiplier: 1.5, max_interval: 60s, start_time: Instant { tv_sec: 1728, tv_nsec: 167572006 }, max_elapsed_time: Some(1200s), clock: SystemClock }, remote_server_uris: ["https://oxide-omicron-build.s3.amazonaws.com"] } } target = phd_framework::artifacts::store
32024-08-30T01:14:09.112ZINFOphd-runner: Adding Propolis server from local command file = phd-tests/framework/src/artifacts/store.rs line = 229 propolis_server_cmd = /work/phd-test/propolis-server target = phd_framework::artifacts::store
42024-08-30T01:14:09.113ZINFOphd-runner: Adding crucible-downstairs from Buildomat Git revision commit = d037eeb9a56a8a62ff17266f340c011224d15146 file = phd-tests/framework/src/artifacts/store.rs line = 313 target = phd_framework::artifacts::store
52024-08-30T01:14:09.113ZDEBGphd-runner: Downloading file from Buildomat... file = phd-tests/framework/src/artifacts/buildomat.rs line = 215 target = phd_framework::artifacts::buildomat timeout = 600s uri = https://buildomat.eng.oxide.computer/public/file/oxidecomputer/crucible/nightly-image/d037eeb9a56a8a62ff17266f340c011224d15146/crucible-nightly.sha256.txt
62024-08-30T01:14:09.222ZWARNphd-runner: No 'migration base' Propolis server provided. Migration-from-base tests will be skipped. file = phd-tests/framework/src/lib.rs line = 178 target = phd_framework
72024-08-30T01:14:09.222ZINFOphd-runner: [EXECUTION_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 25 target = phd_runner::fixtures
82024-08-30T01:14:09.222ZINFOphd-runner: [EXECUTION_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 25 target = phd_runner::fixtures
92024-08-30T01:14:09.223ZINFOphd-runner: Running 26 test(s) file = phd-tests/runner/src/execute.rs line = 82 target = phd_runner::execute
102024-08-30T01:14:09.223ZINFOphd-runner: Starting test phd_tests::framework::multiline_serial_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
112024-08-30T01:14:09.223ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
122024-08-30T01:14:09.223ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
132024-08-30T01:14:09.223ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/framework.rs line = 10 path = phd_tests::framework::multiline_serial_test target = phd_tests::framework
142024-08-30T01:14:09.223ZDEBGphd-runner: [TEST - EVENT] checking for existing copy of artifact file = phd-tests/framework/src/artifacts/store.rs line = 89 maybe_path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd path = phd_tests::framework::multiline_serial_test target = phd_framework::artifacts::store
152024-08-30T01:14:09.224ZDEBGphd-runner: [TEST - EVENT] Downloading file from Buildomat... file = phd-tests/framework/src/artifacts/buildomat.rs line = 215 path = phd_tests::framework::multiline_serial_test target = phd_framework::artifacts::buildomat timeout = 600s uri = https://buildomat.eng.oxide.computer/public/file/oxidecomputer/edk2/image_debug/6d92acf0a22718dd4175d7c64dbcf7aaec3740bd/OVMF_CODE.fd
162024-08-30T01:14:09.765ZDEBGphd-runner: [TEST - EVENT] checking for existing copy of artifact file = phd-tests/framework/src/artifacts/store.rs line = 89 maybe_path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso path = phd_tests::framework::multiline_serial_test target = phd_framework::artifacts::store
172024-08-30T01:14:09.765ZDEBGphd-runner: [TEST - EVENT] Downloading alpine.iso from https://oxide-omicron-build.s3.amazonaws.com/alpine.iso file = phd-tests/framework/src/artifacts/store.rs line = 618 path = phd_tests::framework::multiline_serial_test target = phd_framework::artifacts::store timeout = 600s
182024-08-30T01:14:37.775ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
192024-08-30T01:14:37.775ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = list
202024-08-30T01:14:37.794ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::framework::multiline_serial_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 2.00M 1.80T 1.91M /phd-artifacts\n target = phd_framework::zfs
212024-08-30T01:14:37.795ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-2a8faa4a-4df9-4471-ad16-1b50549f2bcd"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = snapshot
222024-08-30T01:14:37.820ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-2a8faa4a-4df9-4471-ad16-1b50549f2bcd", "phd-artifacts/phd-clone-fa1f4cd1-780d-4bbf-b9bc-cd6f5c3287ae"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = clone
232024-08-30T01:14:37.836ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-fa1f4cd1-780d-4bbf-b9bc-cd6f5c3287ae"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = list
242024-08-30T01:14:37.846ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::framework::multiline_serial_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-fa1f4cd1-780d-4bbf-b9bc-cd6f5c3287ae 0B 1.80T 48.9M /phd-artifacts/phd-clone-fa1f4cd1-780d-4bbf-b9bc-cd6f5c3287ae\n target = phd_framework::zfs
252024-08-30T01:14:37.847ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
262024-08-30T01:14:37.847ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm_name = multiline_test
272024-08-30T01:14:37.847ZDEBGphd-runner: [NEW - EVENT] Examining locally-sourced artifact file = phd-tests/framework/src/artifacts/store.rs line = 56 path = /work/phd-test/propolis-server sha256 = None target = phd_framework::artifacts::store
282024-08-30T01:14:37.847ZDEBGphd-runner: [NEW - EVENT] Locally-sourced artifact is valid, caching its path file = phd-tests/framework/src/artifacts/store.rs line = 69 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
292024-08-30T01:14:37.847ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/multiline_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::framework::multiline_serial_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
302024-08-30T01:14:37.847ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::framework::multiline_serial_test stderr_path = "/tmp/propolis-phd/multiline_test.stderr.log" stdout_path = "/tmp/propolis-phd/multiline_test.stdout.log" target = phd_framework::server_log_mode
312024-08-30T01:14:37.853ZINFOphd-runner: [NEW - EVENT] Launched server with pid 865 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm::server
322024-08-30T01:14:37.853ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
332024-08-30T01:14:37.853ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
342024-08-30T01:14:37.854ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
352024-08-30T01:14:38.416ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
362024-08-30T01:14:38.417ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 37386b72-6b20-4ced-80bc-ff4aa04cab8d, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: f1bb25f1-dc1c-4ff7-9edf-4a3b2ef28c6e, silo_id: d18f8e0e-cdde-4f44-aa02-abf57a709573, sled_id: c7d07073-7b28-4221-9fd0-8c3f63e37a77, sled_model: "pheidippes", sled_revision: 1, sled_serial: "c7d07073-7b28-4221-9fd0-8c3f63e37a77" }, name: "phd-vm-37386b72-6b20-4ced-80bc-ff4aa04cab8d", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
372024-08-30T01:14:38.417ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 564 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
382024-08-30T01:14:38.417ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
392024-08-30T01:14:38.417ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::framework::multiline_serial_test state = Run target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
402024-08-30T01:14:38.418ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
412024-08-30T01:14:38.418ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
422024-08-30T01:14:38.418ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = 300s vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
432024-08-30T01:14:38.418ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::framework::multiline_serial_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
442024-08-30T01:14:38.418ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
452024-08-30T01:14:38.418ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
462024-08-30T01:14:42.607ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4188 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
472024-08-30T01:14:42.607ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::framework::multiline_serial_test step = WriteStr("root") target = phd_framework::test_vm
482024-08-30T01:14:42.607ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::framework::multiline_serial_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
492024-08-30T01:14:42.607ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
502024-08-30T01:14:42.607ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
512024-08-30T01:14:42.623ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 15 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
522024-08-30T01:14:42.623ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
532024-08-30T01:14:42.623ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4205 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm
542024-08-30T01:14:42.624ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
552024-08-30T01:14:42.624ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
562024-08-30T01:14:42.656ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
572024-08-30T01:14:42.656ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
582024-08-30T01:14:42.656ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
592024-08-30T01:14:42.668ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
602024-08-30T01:14:42.668ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
612024-08-30T01:14:42.668ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
622024-08-30T01:14:42.668ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4252 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
632024-08-30T01:14:42.668ZINFOphd-runner: test phd_tests::framework::multiline_serial_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
642024-08-30T01:14:42.668ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
652024-08-30T01:14:42.669ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
662024-08-30T01:14:43.225ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::framework::multiline_serial_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
672024-08-30T01:14:43.334ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
682024-08-30T01:14:43.334ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-fa1f4cd1-780d-4bbf-b9bc-cd6f5c3287ae"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = destroy vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
692024-08-30T01:14:43.359ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
702024-08-30T01:14:43.359ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-2a8faa4a-4df9-4471-ad16-1b50549f2bcd"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::framework::multiline_serial_test target = phd_framework::zfs verb = destroy vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
712024-08-30T01:14:43.379ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 711 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::framework::multiline_serial_test target = phd_framework::test_vm vm = multiline_test vm_id = 37386b72-6b20-4ced-80bc-ff4aa04cab8d
722024-08-30T01:14:43.379ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 34156 file = phd-tests/tests/src/framework.rs line = 10 path = phd_tests::framework::multiline_serial_test target = phd_tests::framework
732024-08-30T01:14:43.380ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 711 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
742024-08-30T01:14:43.380ZINFOphd-runner: Starting test phd_tests::migrate::running_process::export_failure file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
752024-08-30T01:14:43.380ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
762024-08-30T01:14:43.380ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
772024-08-30T01:14:43.380ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 183 path = phd_tests::migrate::running_process::export_failure target = phd_tests::migrate::running_process
782024-08-30T01:14:43.380ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
792024-08-30T01:14:43.380ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
802024-08-30T01:14:43.380ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
812024-08-30T01:14:43.380ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = list
822024-08-30T01:14:43.392ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::export_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.1M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
832024-08-30T01:14:43.392ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-c7037413-4956-4eb2-bc02-522c5f2d2e06"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = snapshot
842024-08-30T01:14:43.410ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-c7037413-4956-4eb2-bc02-522c5f2d2e06", "phd-artifacts/phd-clone-c6eadd0b-e384-46f2-8874-ab83f70013df"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = clone
852024-08-30T01:14:43.428ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-c6eadd0b-e384-46f2-8874-ab83f70013df"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = list
862024-08-30T01:14:43.439ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::export_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-c6eadd0b-e384-46f2-8874-ab83f70013df 0B 1.80T 48.9M /phd-artifacts/phd-clone-c6eadd0b-e384-46f2-8874-ab83f70013df\n target = phd_framework::zfs
872024-08-30T01:14:43.439ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
882024-08-30T01:14:43.439ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm_name = migrate_running_process::export_failure_source
892024-08-30T01:14:43.439ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
902024-08-30T01:14:43.439ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::export_failure_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::export_failure server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
912024-08-30T01:14:43.439ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::export_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::export_failure_source.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::export_failure_source.stdout.log" target = phd_framework::server_log_mode
922024-08-30T01:14:43.444ZINFOphd-runner: [NEW - EVENT] Launched server with pid 873 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm::server
932024-08-30T01:14:43.444ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 4 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
942024-08-30T01:14:43.444ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
952024-08-30T01:14:43.444ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm_name = migrate_running_process::export_failure_target1
962024-08-30T01:14:43.444ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
972024-08-30T01:14:43.444ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::export_failure server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
982024-08-30T01:14:43.444ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::export_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target1.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target1.stdout.log" target = phd_framework::server_log_mode
992024-08-30T01:14:43.449ZINFOphd-runner: [NEW - EVENT] Launched server with pid 874 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm::server
1002024-08-30T01:14:43.449ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
1012024-08-30T01:14:43.450ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
1022024-08-30T01:14:43.450ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm_name = migrate_running_process::export_failure_target2
1032024-08-30T01:14:43.450ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
1042024-08-30T01:14:43.450ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target2.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::export_failure server_addr = 127.0.0.1:9004 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
1052024-08-30T01:14:43.450ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::export_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target2.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::export_failure_target2.stdout.log" target = phd_framework::server_log_mode
1062024-08-30T01:14:43.455ZINFOphd-runner: [NEW - EVENT] Launched server with pid 875 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm::server
1072024-08-30T01:14:43.455ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
1082024-08-30T01:14:43.455ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1092024-08-30T01:14:43.456ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1102024-08-30T01:14:44.088ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
1112024-08-30T01:14:44.089ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: d22708a7-8acf-4d6f-830a-c5dc9dc7c70b, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 277f7cf8-6518-4db8-8fb8-c8a0fb5b7142, silo_id: 97577f24-7959-419e-88ce-520644e5c6cf, sled_id: 75e50a72-e40a-4191-b32c-4e28942d1281, sled_model: "pheidippes", sled_revision: 1, sled_serial: "75e50a72-e40a-4191-b32c-4e28942d1281" }, name: "phd-vm-d22708a7-8acf-4d6f-830a-c5dc9dc7c70b", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1122024-08-30T01:14:44.089ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 633 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1132024-08-30T01:14:44.089ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1142024-08-30T01:14:44.089ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::running_process::export_failure state = Run target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1152024-08-30T01:14:44.089ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1162024-08-30T01:14:44.089ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
1172024-08-30T01:14:44.089ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = 300s vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1182024-08-30T01:14:44.089ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::export_failure step = WaitFor("localhost login: ") target = phd_framework::test_vm
1192024-08-30T01:14:44.089ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1202024-08-30T01:14:44.090ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1212024-08-30T01:14:48.305ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4215 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1222024-08-30T01:14:48.305ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::export_failure step = WriteStr("root") target = phd_framework::test_vm
1232024-08-30T01:14:48.306ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::export_failure step = WaitFor("localhost:~#") target = phd_framework::test_vm
1242024-08-30T01:14:48.306ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1252024-08-30T01:14:48.306ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1262024-08-30T01:14:48.323ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1272024-08-30T01:14:48.323ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
1282024-08-30T01:14:48.323ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4233 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm
1292024-08-30T01:14:48.323ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1302024-08-30T01:14:48.323ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1312024-08-30T01:14:48.531ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 207 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1322024-08-30T01:14:48.531ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1332024-08-30T01:14:48.531ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1342024-08-30T01:14:48.542ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1352024-08-30T01:14:48.542ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1362024-08-30T01:14:48.542ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1372024-08-30T01:14:48.553ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1382024-08-30T01:14:48.553ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1392024-08-30T01:14:48.553ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1402024-08-30T01:14:48.586ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1412024-08-30T01:14:48.586ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1422024-08-30T01:14:48.586ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1432024-08-30T01:14:48.597ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1442024-08-30T01:14:48.598ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1452024-08-30T01:14:48.598ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1462024-08-30T01:14:48.898ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 300 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1472024-08-30T01:14:48.898ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa
1482024-08-30T01:14:48.898ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = b52e3e7b-3113-4c0c-b1a4-30816e94b136 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa timeout_duration = 45s
1492024-08-30T01:14:48.898ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa vm = migrate_running_process::export_failure_target1 vm_id = a366d443-96ab-498a-b593-b80f932bf0fa
1502024-08-30T01:14:49.007ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: a366d443-96ab-498a-b593-b80f932bf0fa, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 277f7cf8-6518-4db8-8fb8-c8a0fb5b7142, silo_id: 97577f24-7959-419e-88ce-520644e5c6cf, sled_id: 46cd2502-2623-44e6-b7f6-95de0461ca88, sled_model: "pheidippes", sled_revision: 1, sled_serial: "46cd2502-2623-44e6-b7f6-95de0461ca88" }, name: "phd-vm-a366d443-96ab-498a-b593-b80f932bf0fa", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa vm = migrate_running_process::export_failure_target1 vm_id = a366d443-96ab-498a-b593-b80f932bf0fa
1512024-08-30T01:14:49.007ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 108 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa vm = migrate_running_process::export_failure_target1 vm_id = a366d443-96ab-498a-b593-b80f932bf0fa
1522024-08-30T01:14:49.007ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = b52e3e7b-3113-4c0c-b1a4-30816e94b136 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa
1532024-08-30T01:14:51.981ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 546 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa
1542024-08-30T01:14:51.981ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 2973 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = b52e3e7b-3113-4c0c-b1a4-30816e94b136 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa
1552024-08-30T01:14:51.981ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 3082 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = a366d443-96ab-498a-b593-b80f932bf0fa
1562024-08-30T01:14:51.981ZINFOphd-runner: [TEST - EVENT] first migration failed as expected error = live migration file = phd-tests/tests/src/migrate.rs line = 217 path = phd_tests::migrate::running_process::export_failure target = phd_tests::migrate::running_process
1572024-08-30T01:14:51.982ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220
1582024-08-30T01:14:51.982ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = 37adcce4-d703-446e-b5f2-d7030340d3be path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220 timeout_duration = 45s
1592024-08-30T01:14:51.982ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220 vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1602024-08-30T01:14:52.095ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: b503d72e-32c2-414e-96e8-73b30f71b220, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 277f7cf8-6518-4db8-8fb8-c8a0fb5b7142, silo_id: 97577f24-7959-419e-88ce-520644e5c6cf, sled_id: e011219a-f29e-4bc2-8684-19a82e49ff6a, sled_model: "pheidippes", sled_revision: 1, sled_serial: "e011219a-f29e-4bc2-8684-19a82e49ff6a" }, name: "phd-vm-b503d72e-32c2-414e-96e8-73b30f71b220", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220 vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1612024-08-30T01:14:52.095ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 113 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220 vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1622024-08-30T01:14:52.095ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 37adcce4-d703-446e-b5f2-d7030340d3be path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220
1632024-08-30T01:14:54.780ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9004","from_start":9375}} target = phd_framework::serial
1642024-08-30T01:14:54.892ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220
1652024-08-30T01:14:54.892ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 2796 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 37adcce4-d703-446e-b5f2-d7030340d3be path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220
1662024-08-30T01:14:54.892ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 2909 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::export_failure source = migrate_running_process::export_failure_source source_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b target = phd_framework::test_vm target_id = b503d72e-32c2-414e-96e8-73b30f71b220
1672024-08-30T01:14:54.892ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1682024-08-30T01:14:54.892ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1692024-08-30T01:14:54.947ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 54 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1702024-08-30T01:14:54.947ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1712024-08-30T01:14:54.947ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1722024-08-30T01:14:55.035ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 88 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1732024-08-30T01:14:55.036ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1742024-08-30T01:14:55.036ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target1 vm_id = a366d443-96ab-498a-b593-b80f932bf0fa
1752024-08-30T01:14:55.036ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1762024-08-30T01:14:55.036ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
1772024-08-30T01:14:55.036ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 10948 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
1782024-08-30T01:14:55.036ZINFOphd-runner: test phd_tests::migrate::running_process::export_failure ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
1792024-08-30T01:14:55.037ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
1802024-08-30T01:14:55.037ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1812024-08-30T01:14:55.037ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target1 vm_id = a366d443-96ab-498a-b593-b80f932bf0fa
1822024-08-30T01:14:55.038ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::export_failure self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1832024-08-30T01:14:55.045ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::export_failure self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migrate_running_process::export_failure_target1 vm_id = a366d443-96ab-498a-b593-b80f932bf0fa
1842024-08-30T01:14:55.052ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::export_failure self.address = 127.0.0.1:9004 target = phd_framework::test_vm::server vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1852024-08-30T01:14:55.143ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 106 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_source vm_id = d22708a7-8acf-4d6f-830a-c5dc9dc7c70b
1862024-08-30T01:14:55.230ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 193 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target1 vm_id = a366d443-96ab-498a-b593-b80f932bf0fa
1872024-08-30T01:14:55.319ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1882024-08-30T01:14:55.319ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-c6eadd0b-e384-46f2-8874-ab83f70013df"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1892024-08-30T01:14:55.347ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1902024-08-30T01:14:55.347ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-c7037413-4956-4eb2-bc02-522c5f2d2e06"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::export_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1912024-08-30T01:14:55.363ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 327 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::export_failure target = phd_framework::test_vm vm = migrate_running_process::export_failure_target2 vm_id = b503d72e-32c2-414e-96e8-73b30f71b220
1922024-08-30T01:14:55.364ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 11983 file = phd-tests/tests/src/migrate.rs line = 183 path = phd_tests::migrate::running_process::export_failure target = phd_tests::migrate::running_process
1932024-08-30T01:14:55.364ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 327 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
1942024-08-30T01:14:55.364ZINFOphd-runner: Starting test phd_tests::migrate::running_process::import_failure file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
1952024-08-30T01:14:55.364ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
1962024-08-30T01:14:55.364ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
1972024-08-30T01:14:55.364ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 122 path = phd_tests::migrate::running_process::import_failure target = phd_tests::migrate::running_process
1982024-08-30T01:14:55.364ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
1992024-08-30T01:14:55.364ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
2002024-08-30T01:14:55.364ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
2012024-08-30T01:14:55.364ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = list
2022024-08-30T01:14:55.376ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::import_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.5M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
2032024-08-30T01:14:55.376ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-395cfe62-e74c-4f38-be16-86b82a786c42"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = snapshot
2042024-08-30T01:14:55.393ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-395cfe62-e74c-4f38-be16-86b82a786c42", "phd-artifacts/phd-clone-3764d94d-f8fb-4686-b6fe-7a51040a3187"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = clone
2052024-08-30T01:14:55.411ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-3764d94d-f8fb-4686-b6fe-7a51040a3187"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = list
2062024-08-30T01:14:55.423ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::import_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-3764d94d-f8fb-4686-b6fe-7a51040a3187 0B 1.80T 48.9M /phd-artifacts/phd-clone-3764d94d-f8fb-4686-b6fe-7a51040a3187\n target = phd_framework::zfs
2072024-08-30T01:14:55.423ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2082024-08-30T01:14:55.423ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm_name = migrate_running_process::import_failure_source
2092024-08-30T01:14:55.423ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
2102024-08-30T01:14:55.424ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::import_failure_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::import_failure server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
2112024-08-30T01:14:55.424ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::import_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::import_failure_source.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::import_failure_source.stdout.log" target = phd_framework::server_log_mode
2122024-08-30T01:14:55.429ZINFOphd-runner: [NEW - EVENT] Launched server with pid 885 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm::server
2132024-08-30T01:14:55.429ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2142024-08-30T01:14:55.429ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
2152024-08-30T01:14:55.429ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
2162024-08-30T01:14:55.429ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
2172024-08-30T01:14:55.429ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = list
2182024-08-30T01:14:55.440ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::import_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.8M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
2192024-08-30T01:14:55.440ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-b92073d5-e6a5-4241-a043-d2b1f96332aa"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = snapshot
2202024-08-30T01:14:55.457ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-b92073d5-e6a5-4241-a043-d2b1f96332aa", "phd-artifacts/phd-clone-64c8da5c-7e49-4606-b0b4-f655204b6c15"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = clone
2212024-08-30T01:14:55.473ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-64c8da5c-7e49-4606-b0b4-f655204b6c15"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = list
2222024-08-30T01:14:55.484ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::import_failure stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-64c8da5c-7e49-4606-b0b4-f655204b6c15 0B 1.80T 48.9M /phd-artifacts/phd-clone-64c8da5c-7e49-4606-b0b4-f655204b6c15\n target = phd_framework::zfs
2232024-08-30T01:14:55.484ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2242024-08-30T01:14:55.484ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm_name = migrate_running_process::import_failure_target1
2252024-08-30T01:14:55.484ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
2262024-08-30T01:14:55.485ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::import_failure server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
2272024-08-30T01:14:55.485ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::import_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target1.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target1.stdout.log" target = phd_framework::server_log_mode
2282024-08-30T01:14:55.490ZINFOphd-runner: [NEW - EVENT] Launched server with pid 890 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm::server
2292024-08-30T01:14:55.490ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2302024-08-30T01:14:55.490ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2312024-08-30T01:14:55.490ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm_name = migrate_running_process::import_failure_target2
2322024-08-30T01:14:55.490ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
2332024-08-30T01:14:55.490ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target2.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::import_failure server_addr = 127.0.0.1:9004 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
2342024-08-30T01:14:55.490ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::import_failure stderr_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target2.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process::import_failure_target2.stdout.log" target = phd_framework::server_log_mode
2352024-08-30T01:14:55.495ZINFOphd-runner: [NEW - EVENT] Launched server with pid 891 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm::server
2362024-08-30T01:14:55.495ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2372024-08-30T01:14:55.495ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2382024-08-30T01:14:55.612ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
2392024-08-30T01:14:55.612ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 78610794-18b3-4381-8747-febdb39f2dbd, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 677bbb74-3047-4e9f-b33e-d8edf71aa1bb, silo_id: 00927c6e-b86a-4ca6-8d3f-e0cc358d772d, sled_id: 26a29d88-d1dc-47a7-9787-7d6dd7bcdbd3, sled_model: "pheidippes", sled_revision: 1, sled_serial: "26a29d88-d1dc-47a7-9787-7d6dd7bcdbd3" }, name: "phd-vm-78610794-18b3-4381-8747-febdb39f2dbd", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2402024-08-30T01:14:55.613ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 117 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2412024-08-30T01:14:55.613ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2422024-08-30T01:14:55.613ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::running_process::import_failure state = Run target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2432024-08-30T01:14:55.613ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2442024-08-30T01:14:55.613ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2452024-08-30T01:14:55.613ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = 300s vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2462024-08-30T01:14:55.613ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::import_failure step = WaitFor("localhost login: ") target = phd_framework::test_vm
2472024-08-30T01:14:55.613ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2482024-08-30T01:14:55.613ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2492024-08-30T01:14:59.823ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4209 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2502024-08-30T01:14:59.823ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::import_failure step = WriteStr("root") target = phd_framework::test_vm
2512024-08-30T01:14:59.823ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::import_failure step = WaitFor("localhost:~#") target = phd_framework::test_vm
2522024-08-30T01:14:59.823ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2532024-08-30T01:14:59.823ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2542024-08-30T01:14:59.840ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2552024-08-30T01:14:59.840ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2562024-08-30T01:14:59.840ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4227 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm
2572024-08-30T01:14:59.841ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2582024-08-30T01:14:59.841ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2592024-08-30T01:14:59.929ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 88 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2602024-08-30T01:14:59.929ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2612024-08-30T01:14:59.929ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2622024-08-30T01:14:59.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 9 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2632024-08-30T01:14:59.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2642024-08-30T01:14:59.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2652024-08-30T01:14:59.950ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2662024-08-30T01:14:59.950ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2672024-08-30T01:14:59.950ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2682024-08-30T01:14:59.971ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2692024-08-30T01:14:59.972ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2702024-08-30T01:14:59.972ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2712024-08-30T01:14:59.983ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2722024-08-30T01:14:59.983ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2732024-08-30T01:14:59.983ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2742024-08-30T01:15:00.303ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 319 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
2752024-08-30T01:15:00.304ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
2762024-08-30T01:15:00.304ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = a2a1ff77-541a-42cf-a37b-452dfa876fc2 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93 timeout_duration = 45s
2772024-08-30T01:15:00.304ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93 vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
2782024-08-30T01:15:00.410ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 87b826cf-eb60-46cc-bd8b-249cc86f0d93, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 27e2f0a5-f67c-4f1b-a14d-ca61105d8135, silo_id: c024fe19-2947-4238-8930-523591e182c2, sled_id: 32f42ac9-89ba-4bbf-9cd3-c644740bea0b, sled_model: "pheidippes", sled_revision: 1, sled_serial: "32f42ac9-89ba-4bbf-9cd3-c644740bea0b" }, name: "phd-vm-87b826cf-eb60-46cc-bd8b-249cc86f0d93", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93 vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
2792024-08-30T01:15:00.410ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 106 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93 vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
2802024-08-30T01:15:00.410ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = a2a1ff77-541a-42cf-a37b-452dfa876fc2 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
2812024-08-30T01:15:04.449ZINFOphd-runner: [MIGRATE_FROM - EVENT] Instance reported error during migration file = phd-tests/framework/src/test_vm/mod.rs line = 546 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
2822024-08-30T01:15:04.450ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4039 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = a2a1ff77-541a-42cf-a37b-452dfa876fc2 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
2832024-08-30T01:15:04.450ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4146 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
2842024-08-30T01:15:04.450ZINFOphd-runner: [TEST - EVENT] first migration failed as expected error = live migration file = phd-tests/tests/src/migrate.rs line = 164 path = phd_tests::migrate::running_process::import_failure target = phd_tests::migrate::running_process
2852024-08-30T01:15:04.450ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2862024-08-30T01:15:04.450ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = 840def09-6bb2-4b4d-a868-4e5b0c6257dc path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c timeout_duration = 45s
2872024-08-30T01:15:04.450ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2882024-08-30T01:15:04.555ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 677bbb74-3047-4e9f-b33e-d8edf71aa1bb, silo_id: 00927c6e-b86a-4ca6-8d3f-e0cc358d772d, sled_id: 2f9cfd08-ad1d-4211-8d24-f3e46452798a, sled_model: "pheidippes", sled_revision: 1, sled_serial: "2f9cfd08-ad1d-4211-8d24-f3e46452798a" }, name: "phd-vm-4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2892024-08-30T01:15:04.555ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 105 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2902024-08-30T01:15:04.556ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 840def09-6bb2-4b4d-a868-4e5b0c6257dc path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2912024-08-30T01:15:07.221ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9004","from_start":9375}} target = phd_framework::serial
2922024-08-30T01:15:07.498ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2932024-08-30T01:15:07.498ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 2942 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 840def09-6bb2-4b4d-a868-4e5b0c6257dc path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2942024-08-30T01:15:07.498ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 3047 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::import_failure source = migrate_running_process::import_failure_source source_id = 78610794-18b3-4381-8747-febdb39f2dbd target = phd_framework::test_vm target_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2952024-08-30T01:15:07.498ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2962024-08-30T01:15:07.498ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2972024-08-30T01:15:10.455ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 2956 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2982024-08-30T01:15:10.456ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
2992024-08-30T01:15:10.456ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3002024-08-30T01:15:10.543ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 87 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3012024-08-30T01:15:10.543ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3022024-08-30T01:15:10.544ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
3032024-08-30T01:15:10.544ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
3042024-08-30T01:15:10.544ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
3052024-08-30T01:15:10.544ZINFOphd-runner: test phd_tests::migrate::running_process::import_failure ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
3062024-08-30T01:15:10.544ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 14932 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
3072024-08-30T01:15:10.544ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
3082024-08-30T01:15:10.545ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3092024-08-30T01:15:10.545ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
3102024-08-30T01:15:10.546ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::import_failure self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
3112024-08-30T01:15:10.553ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::import_failure self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
3122024-08-30T01:15:10.560ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::import_failure self.address = 127.0.0.1:9004 target = phd_framework::test_vm::server vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3132024-08-30T01:15:10.670ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 125 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_source vm_id = 78610794-18b3-4381-8747-febdb39f2dbd
3142024-08-30T01:15:10.755ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
3152024-08-30T01:15:10.755ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-64c8da5c-7e49-4606-b0b4-f655204b6c15"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
3162024-08-30T01:15:10.776ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
3172024-08-30T01:15:10.776ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-b92073d5-e6a5-4241-a043-d2b1f96332aa"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
3182024-08-30T01:15:10.797ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 253 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target1 vm_id = 87b826cf-eb60-46cc-bd8b-249cc86f0d93
3192024-08-30T01:15:10.845ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3202024-08-30T01:15:10.845ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-3764d94d-f8fb-4686-b6fe-7a51040a3187"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3212024-08-30T01:15:10.872ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3222024-08-30T01:15:10.872ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-395cfe62-e74c-4f38-be16-86b82a786c42"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::import_failure target = phd_framework::zfs verb = destroy vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3232024-08-30T01:15:10.892ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 347 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::import_failure target = phd_framework::test_vm vm = migrate_running_process::import_failure_target2 vm_id = 4b368ebc-6ccb-48a3-bcba-8b1f4e41bd4c
3242024-08-30T01:15:10.892ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 15527 file = phd-tests/tests/src/migrate.rs line = 122 path = phd_tests::migrate::running_process::import_failure target = phd_tests::migrate::running_process
3252024-08-30T01:15:10.892ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 347 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
3262024-08-30T01:15:10.892ZINFOphd-runner: Starting test phd_tests::migrate::running_process::migrate_running_process file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
3272024-08-30T01:15:10.892ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
3282024-08-30T01:15:10.892ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
3292024-08-30T01:15:10.892ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 102 path = phd_tests::migrate::running_process::migrate_running_process target = phd_tests::migrate::running_process
3302024-08-30T01:15:10.892ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
3312024-08-30T01:15:10.893ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
3322024-08-30T01:15:10.893ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
3332024-08-30T01:15:10.893ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = list
3342024-08-30T01:15:10.906ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::migrate_running_process stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.3M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
3352024-08-30T01:15:10.906ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-097cdc21-8903-4246-baa5-85d43f8c6cbb"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = snapshot
3362024-08-30T01:15:10.921ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-097cdc21-8903-4246-baa5-85d43f8c6cbb", "phd-artifacts/phd-clone-e919c7ea-c8f5-4955-8ee1-fd734fbe8005"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = clone
3372024-08-30T01:15:10.938ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-e919c7ea-c8f5-4955-8ee1-fd734fbe8005"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = list
3382024-08-30T01:15:10.948ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::running_process::migrate_running_process stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-e919c7ea-c8f5-4955-8ee1-fd734fbe8005 0B 1.80T 48.9M /phd-artifacts/phd-clone-e919c7ea-c8f5-4955-8ee1-fd734fbe8005\n target = phd_framework::zfs
3392024-08-30T01:15:10.949ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
3402024-08-30T01:15:10.949ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm_name = migrate_running_process_source
3412024-08-30T01:15:10.949ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
3422024-08-30T01:15:10.949ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::migrate_running_process server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
3432024-08-30T01:15:10.949ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::migrate_running_process stderr_path = "/tmp/propolis-phd/migrate_running_process_source.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process_source.stdout.log" target = phd_framework::server_log_mode
3442024-08-30T01:15:10.954ZINFOphd-runner: [NEW - EVENT] Launched server with pid 903 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm::server
3452024-08-30T01:15:10.955ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
3462024-08-30T01:15:10.955ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
3472024-08-30T01:15:10.955ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm_name = migrate_running_process_target
3482024-08-30T01:15:10.955ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
3492024-08-30T01:15:10.955ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migrate_running_process_target.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::running_process::migrate_running_process server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
3502024-08-30T01:15:10.955ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::running_process::migrate_running_process stderr_path = "/tmp/propolis-phd/migrate_running_process_target.stderr.log" stdout_path = "/tmp/propolis-phd/migrate_running_process_target.stdout.log" target = phd_framework::server_log_mode
3512024-08-30T01:15:10.960ZINFOphd-runner: [NEW - EVENT] Launched server with pid 904 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm::server
3522024-08-30T01:15:10.960ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
3532024-08-30T01:15:10.960ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3542024-08-30T01:15:10.961ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3552024-08-30T01:15:11.452ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
3562024-08-30T01:15:11.453ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: aa06a19c-937b-45e8-959a-bbab32ea7e74, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: d7b8bd56-2fbf-4ea5-96ce-5a0f8c2457ae, silo_id: 0b1b332a-5dd5-493a-b487-da6949e1a30a, sled_id: 9ef3d567-c349-4aaa-8430-848541885e25, sled_model: "pheidippes", sled_revision: 1, sled_serial: "9ef3d567-c349-4aaa-8430-848541885e25" }, name: "phd-vm-aa06a19c-937b-45e8-959a-bbab32ea7e74", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3572024-08-30T01:15:11.453ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 492 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3582024-08-30T01:15:11.453ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3592024-08-30T01:15:11.454ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::running_process::migrate_running_process state = Run target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3602024-08-30T01:15:11.454ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3612024-08-30T01:15:11.454ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
3622024-08-30T01:15:11.454ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = 300s vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3632024-08-30T01:15:11.454ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::migrate_running_process step = WaitFor("localhost login: ") target = phd_framework::test_vm
3642024-08-30T01:15:11.454ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3652024-08-30T01:15:11.454ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3662024-08-30T01:15:15.679ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4224 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3672024-08-30T01:15:15.679ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::migrate_running_process step = WriteStr("root") target = phd_framework::test_vm
3682024-08-30T01:15:15.679ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::running_process::migrate_running_process step = WaitFor("localhost:~#") target = phd_framework::test_vm
3692024-08-30T01:15:15.679ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3702024-08-30T01:15:15.679ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3712024-08-30T01:15:15.696ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3722024-08-30T01:15:15.696ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
3732024-08-30T01:15:15.696ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4242 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm
3742024-08-30T01:15:15.697ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3752024-08-30T01:15:15.697ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3762024-08-30T01:15:15.785ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 88 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3772024-08-30T01:15:15.786ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3782024-08-30T01:15:15.786ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3792024-08-30T01:15:15.796ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3802024-08-30T01:15:15.796ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3812024-08-30T01:15:15.796ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3822024-08-30T01:15:15.807ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3832024-08-30T01:15:15.807ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3842024-08-30T01:15:15.807ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3852024-08-30T01:15:15.829ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3862024-08-30T01:15:15.829ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3872024-08-30T01:15:15.829ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3882024-08-30T01:15:15.839ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3892024-08-30T01:15:15.840ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3902024-08-30T01:15:15.840ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3912024-08-30T01:15:16.145ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 305 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
3922024-08-30T01:15:16.145ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
3932024-08-30T01:15:16.145ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = 15859f13-f28f-4757-8908-867a1a9bd425 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009 timeout_duration = 45s
3942024-08-30T01:15:16.145ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009 vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
3952024-08-30T01:15:16.261ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: ecd49f36-c26c-4426-8ebd-1a10b1a59009, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: d7b8bd56-2fbf-4ea5-96ce-5a0f8c2457ae, silo_id: 0b1b332a-5dd5-493a-b487-da6949e1a30a, sled_id: a2a0180a-5626-405e-8b94-e082691b1b29, sled_model: "pheidippes", sled_revision: 1, sled_serial: "a2a0180a-5626-405e-8b94-e082691b1b29" }, name: "phd-vm-ecd49f36-c26c-4426-8ebd-1a10b1a59009", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009 vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
3962024-08-30T01:15:16.261ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 115 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009 vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
3972024-08-30T01:15:16.261ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 15859f13-f28f-4757-8908-867a1a9bd425 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
3982024-08-30T01:15:18.949ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":9375}} target = phd_framework::serial
3992024-08-30T01:15:19.620ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4002024-08-30T01:15:19.620ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 3358 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 15859f13-f28f-4757-8908-867a1a9bd425 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4012024-08-30T01:15:19.620ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 3474 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::running_process::migrate_running_process source = migrate_running_process_source source_id = aa06a19c-937b-45e8-959a-bbab32ea7e74 target = phd_framework::test_vm target_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4022024-08-30T01:15:19.620ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4032024-08-30T01:15:19.620ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4042024-08-30T01:15:19.631ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4052024-08-30T01:15:19.631ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4062024-08-30T01:15:19.631ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4072024-08-30T01:15:19.721ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 89 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4082024-08-30T01:15:19.721ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4092024-08-30T01:15:19.721ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
4102024-08-30T01:15:19.721ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
4112024-08-30T01:15:19.721ZINFOphd-runner: test phd_tests::migrate::running_process::migrate_running_process ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
4122024-08-30T01:15:19.721ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 8268 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
4132024-08-30T01:15:19.721ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
4142024-08-30T01:15:19.722ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4152024-08-30T01:15:19.723ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::migrate_running_process self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
4162024-08-30T01:15:19.852ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 131 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_source vm_id = aa06a19c-937b-45e8-959a-bbab32ea7e74
4172024-08-30T01:15:19.854ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::running_process::migrate_running_process self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4182024-08-30T01:15:19.991ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4192024-08-30T01:15:19.991ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-e919c7ea-c8f5-4955-8ee1-fd734fbe8005"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = destroy vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4202024-08-30T01:15:20.019ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4212024-08-30T01:15:20.019ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-097cdc21-8903-4246-baa5-85d43f8c6cbb"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::zfs verb = destroy vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4222024-08-30T01:15:20.041ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 319 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::running_process::migrate_running_process target = phd_framework::test_vm vm = migrate_running_process_target vm_id = ecd49f36-c26c-4426-8ebd-1a10b1a59009
4232024-08-30T01:15:20.041ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 9148 file = phd-tests/tests/src/migrate.rs line = 102 path = phd_tests::migrate::running_process::migrate_running_process target = phd_tests::migrate::running_process
4242024-08-30T01:15:20.041ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 319 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
4252024-08-30T01:15:20.041ZINFOphd-runner: Starting test phd_tests::migrate::vm_reaches_destroyed_after_migration_out file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
4262024-08-30T01:15:20.041ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
4272024-08-30T01:15:20.041ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
4282024-08-30T01:15:20.041ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 447 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_tests::migrate
4292024-08-30T01:15:20.041ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
4302024-08-30T01:15:20.041ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
4312024-08-30T01:15:20.041ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
4322024-08-30T01:15:20.041ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::zfs verb = list
4332024-08-30T01:15:20.053ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.4M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
4342024-08-30T01:15:20.053ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-6155a85b-e09c-4a23-afe3-c4f7e12e9b1d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::zfs verb = snapshot
4352024-08-30T01:15:20.068ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-6155a85b-e09c-4a23-afe3-c4f7e12e9b1d", "phd-artifacts/phd-clone-abc9da1f-208f-45a0-a690-2a36b8179d05"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::zfs verb = clone
4362024-08-30T01:15:20.088ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-abc9da1f-208f-45a0-a690-2a36b8179d05"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::zfs verb = list
4372024-08-30T01:15:20.098ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-abc9da1f-208f-45a0-a690-2a36b8179d05 0B 1.80T 48.9M /phd-artifacts/phd-clone-abc9da1f-208f-45a0-a690-2a36b8179d05\n target = phd_framework::zfs
4382024-08-30T01:15:20.099ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm
4392024-08-30T01:15:20.099ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm_name = vm_reaches_destroyed_after_migration_out_source
4402024-08-30T01:15:20.099ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
4412024-08-30T01:15:20.099ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/vm_reaches_destroyed_after_migration_out_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
4422024-08-30T01:15:20.099ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out stderr_path = "/tmp/propolis-phd/vm_reaches_destroyed_after_migration_out_source.stderr.log" stdout_path = "/tmp/propolis-phd/vm_reaches_destroyed_after_migration_out_source.stdout.log" target = phd_framework::server_log_mode
4432024-08-30T01:15:20.104ZINFOphd-runner: [NEW - EVENT] Launched server with pid 913 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm::server
4442024-08-30T01:15:20.104ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm
4452024-08-30T01:15:20.104ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm
4462024-08-30T01:15:20.104ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm_name = vm_reaches_destroyed_after_migration_out_target
4472024-08-30T01:15:20.105ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
4482024-08-30T01:15:20.105ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/vm_reaches_destroyed_after_migration_out_target.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
4492024-08-30T01:15:20.105ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out stderr_path = "/tmp/propolis-phd/vm_reaches_destroyed_after_migration_out_target.stderr.log" stdout_path = "/tmp/propolis-phd/vm_reaches_destroyed_after_migration_out_target.stdout.log" target = phd_framework::server_log_mode
4502024-08-30T01:15:20.110ZINFOphd-runner: [NEW - EVENT] Launched server with pid 914 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm::server
4512024-08-30T01:15:20.110ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm
4522024-08-30T01:15:20.110ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4532024-08-30T01:15:20.110ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4542024-08-30T01:15:20.850ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
4552024-08-30T01:15:20.851ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 33333ac1-8e6a-45de-a1a5-f5c872823373, silo_id: 6b194596-2f6a-4ea4-be50-b8b328abdd5a, sled_id: 124eba0c-5da2-4dfa-9407-1bf6e98430a7, sled_model: "pheidippes", sled_revision: 1, sled_serial: "124eba0c-5da2-4dfa-9407-1bf6e98430a7" }, name: "phd-vm-d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4562024-08-30T01:15:20.851ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 740 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4572024-08-30T01:15:20.851ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4582024-08-30T01:15:20.851ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out state = Run target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4592024-08-30T01:15:20.852ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4602024-08-30T01:15:20.852ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm
4612024-08-30T01:15:20.852ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm timeout_duration = 300s vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4622024-08-30T01:15:20.852ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out step = WaitFor("localhost login: ") target = phd_framework::test_vm
4632024-08-30T01:15:20.852ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4642024-08-30T01:15:20.852ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm timeout_duration = CallerTimeout vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4652024-08-30T01:15:25.081ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4229 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4662024-08-30T01:15:25.081ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out step = WriteStr("root") target = phd_framework::test_vm
4672024-08-30T01:15:25.081ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out step = WaitFor("localhost:~#") target = phd_framework::test_vm
4682024-08-30T01:15:25.081ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4692024-08-30T01:15:25.081ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm timeout_duration = CallerTimeout vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4702024-08-30T01:15:25.098ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4712024-08-30T01:15:25.098ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm
4722024-08-30T01:15:25.098ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4246 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm
4732024-08-30T01:15:25.098ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4742024-08-30T01:15:25.099ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = 0550a2ea-c804-4849-897c-527640acf364 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c timeout_duration = 45s
4752024-08-30T01:15:25.099ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4762024-08-30T01:15:25.206ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 9cc087b0-5508-4967-affd-c29fefb06a8c, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 33333ac1-8e6a-45de-a1a5-f5c872823373, silo_id: 6b194596-2f6a-4ea4-be50-b8b328abdd5a, sled_id: 6ecc97b7-914c-4f61-a62e-1138dfdfe838, sled_model: "pheidippes", sled_revision: 1, sled_serial: "6ecc97b7-914c-4f61-a62e-1138dfdfe838" }, name: "phd-vm-9cc087b0-5508-4967-affd-c29fefb06a8c", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4772024-08-30T01:15:25.206ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 107 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4782024-08-30T01:15:25.206ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 0550a2ea-c804-4849-897c-527640acf364 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4792024-08-30T01:15:27.922ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":7609}} target = phd_framework::serial
4802024-08-30T01:15:29.095ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4812024-08-30T01:15:29.095ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 3888 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 0550a2ea-c804-4849-897c-527640acf364 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4822024-08-30T01:15:29.095ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 3996 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out source = vm_reaches_destroyed_after_migration_out_source source_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1 target = phd_framework::test_vm target_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4832024-08-30T01:15:29.095ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4842024-08-30T01:15:29.095ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4852024-08-30T01:15:29.095ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4862024-08-30T01:15:29.095ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4872024-08-30T01:15:29.096ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4882024-08-30T01:15:29.096ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4892024-08-30T01:15:29.096ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4902024-08-30T01:15:29.096ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4912024-08-30T01:15:29.096ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
4922024-08-30T01:15:29.096ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 8246 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
4932024-08-30T01:15:29.096ZINFOphd-runner: test phd_tests::migrate::vm_reaches_destroyed_after_migration_out ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
4942024-08-30T01:15:29.096ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
4952024-08-30T01:15:29.097ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4962024-08-30T01:15:29.211ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 115 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_source vm_id = d046c8b6-3ea5-403f-80a2-5b81fb8ed7d1
4972024-08-30T01:15:29.212ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4982024-08-30T01:15:29.767ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
4992024-08-30T01:15:29.875ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::zfs vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
5002024-08-30T01:15:29.875ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-abc9da1f-208f-45a0-a690-2a36b8179d05"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::zfs verb = destroy vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
5012024-08-30T01:15:29.903ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::zfs vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
5022024-08-30T01:15:29.903ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-6155a85b-e09c-4a23-afe3-c4f7e12e9b1d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::zfs verb = destroy vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
5032024-08-30T01:15:29.920ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 823 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_framework::test_vm vm = vm_reaches_destroyed_after_migration_out_target vm_id = 9cc087b0-5508-4967-affd-c29fefb06a8c
5042024-08-30T01:15:29.920ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 9879 file = phd-tests/tests/src/migrate.rs line = 447 path = phd_tests::migrate::vm_reaches_destroyed_after_migration_out target = phd_tests::migrate
5052024-08-30T01:15:29.920ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 823 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
5062024-08-30T01:15:29.921ZINFOphd-runner: Starting test phd_tests::migrate::migration_ensures_instance_metadata file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
5072024-08-30T01:15:29.921ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
5082024-08-30T01:15:29.921ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
5092024-08-30T01:15:29.921ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 402 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_tests::migrate
5102024-08-30T01:15:29.921ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
5112024-08-30T01:15:29.921ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
5122024-08-30T01:15:29.921ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
5132024-08-30T01:15:29.921ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::zfs verb = list
5142024-08-30T01:15:29.935ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::migration_ensures_instance_metadata stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.7M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
5152024-08-30T01:15:29.936ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-62e3e180-ee29-4700-9ac3-a559b6bc90f2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::zfs verb = snapshot
5162024-08-30T01:15:29.952ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-62e3e180-ee29-4700-9ac3-a559b6bc90f2", "phd-artifacts/phd-clone-5f28910a-93bf-4fb8-b2c0-8f8d59cfc254"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::zfs verb = clone
5172024-08-30T01:15:29.971ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-5f28910a-93bf-4fb8-b2c0-8f8d59cfc254"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::zfs verb = list
5182024-08-30T01:15:29.982ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::migration_ensures_instance_metadata stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-5f28910a-93bf-4fb8-b2c0-8f8d59cfc254 0B 1.80T 48.9M /phd-artifacts/phd-clone-5f28910a-93bf-4fb8-b2c0-8f8d59cfc254\n target = phd_framework::zfs
5192024-08-30T01:15:29.982ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm
5202024-08-30T01:15:29.982ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm_name = migration_ensures_instance_metadata_source
5212024-08-30T01:15:29.982ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
5222024-08-30T01:15:29.982ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_ensures_instance_metadata_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::migration_ensures_instance_metadata server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
5232024-08-30T01:15:29.982ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::migration_ensures_instance_metadata stderr_path = "/tmp/propolis-phd/migration_ensures_instance_metadata_source.stderr.log" stdout_path = "/tmp/propolis-phd/migration_ensures_instance_metadata_source.stdout.log" target = phd_framework::server_log_mode
5242024-08-30T01:15:29.987ZINFOphd-runner: [NEW - EVENT] Launched server with pid 923 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm::server
5252024-08-30T01:15:29.988ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm
5262024-08-30T01:15:29.988ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm
5272024-08-30T01:15:29.988ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm_name = migration_ensures_instance_metadata_target
5282024-08-30T01:15:29.988ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
5292024-08-30T01:15:29.988ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_ensures_instance_metadata_target.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::migration_ensures_instance_metadata server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
5302024-08-30T01:15:29.988ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::migration_ensures_instance_metadata stderr_path = "/tmp/propolis-phd/migration_ensures_instance_metadata_target.stderr.log" stdout_path = "/tmp/propolis-phd/migration_ensures_instance_metadata_target.stdout.log" target = phd_framework::server_log_mode
5312024-08-30T01:15:29.993ZINFOphd-runner: [NEW - EVENT] Launched server with pid 924 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm::server
5322024-08-30T01:15:29.993ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm
5332024-08-30T01:15:29.993ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5342024-08-30T01:15:29.993ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5352024-08-30T01:15:30.491ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
5362024-08-30T01:15:30.492ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 94eaf610-1afc-4255-9d2b-dd3588a7ea0a, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: a19c86c2-2e62-45b0-8d74-fc5772b12ae8, silo_id: af6d425e-6492-4ef0-aef7-b590a34a4f50, sled_id: cc01ad88-0d24-4fc6-b03a-9789d6fc052b, sled_model: "pheidippes", sled_revision: 1, sled_serial: "cc01ad88-0d24-4fc6-b03a-9789d6fc052b" }, name: "phd-vm-94eaf610-1afc-4255-9d2b-dd3588a7ea0a", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5372024-08-30T01:15:30.492ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 498 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5382024-08-30T01:15:30.492ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5392024-08-30T01:15:30.492ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::migration_ensures_instance_metadata state = Run target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5402024-08-30T01:15:30.492ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5412024-08-30T01:15:30.492ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm
5422024-08-30T01:15:30.493ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm timeout_duration = 300s vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5432024-08-30T01:15:30.493ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::migration_ensures_instance_metadata step = WaitFor("localhost login: ") target = phd_framework::test_vm
5442024-08-30T01:15:30.493ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5452024-08-30T01:15:30.493ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5462024-08-30T01:15:34.761ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4268 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5472024-08-30T01:15:34.761ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::migration_ensures_instance_metadata step = WriteStr("root") target = phd_framework::test_vm
5482024-08-30T01:15:34.762ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::migration_ensures_instance_metadata step = WaitFor("localhost:~#") target = phd_framework::test_vm
5492024-08-30T01:15:34.762ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5502024-08-30T01:15:34.762ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5512024-08-30T01:15:34.778ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 15 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5522024-08-30T01:15:34.778ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm
5532024-08-30T01:15:34.778ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4285 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm
5542024-08-30T01:15:34.778ZINFOphd-runner: [GET_SPEC - START] file = phd-tests/framework/src/test_vm/mod.rs line = 463 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5552024-08-30T01:15:34.778ZINFOphd-runner: [GET_SPEC - EVENT] Sending instance spec get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 465 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5562024-08-30T01:15:34.779ZINFOphd-runner: [GET_SPEC - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 463 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5572024-08-30T01:15:34.779ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5582024-08-30T01:15:34.779ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = 05715ebf-b3c4-4d75-88ee-f9e6bbb70465 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7 timeout_duration = 45s
5592024-08-30T01:15:34.779ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7 vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5602024-08-30T01:15:34.897ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 215a7c51-e02f-49ec-913f-645e6a846db7, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: a19c86c2-2e62-45b0-8d74-fc5772b12ae8, silo_id: af6d425e-6492-4ef0-aef7-b590a34a4f50, sled_id: 58e0f376-45e9-4484-b8f7-0895f4719308, sled_model: "pheidippes", sled_revision: 1, sled_serial: "58e0f376-45e9-4484-b8f7-0895f4719308" }, name: "phd-vm-215a7c51-e02f-49ec-913f-645e6a846db7", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7 vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5612024-08-30T01:15:34.897ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 117 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7 vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5622024-08-30T01:15:34.898ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 05715ebf-b3c4-4d75-88ee-f9e6bbb70465 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5632024-08-30T01:15:37.591ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":7609}} target = phd_framework::serial
5642024-08-30T01:15:39.293ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5652024-08-30T01:15:39.293ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4395 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 05715ebf-b3c4-4d75-88ee-f9e6bbb70465 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5662024-08-30T01:15:39.293ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4513 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::migration_ensures_instance_metadata source = migration_ensures_instance_metadata_source source_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a target = phd_framework::test_vm target_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5672024-08-30T01:15:39.293ZINFOphd-runner: [GET_SPEC - START] file = phd-tests/framework/src/test_vm/mod.rs line = 463 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5682024-08-30T01:15:39.293ZINFOphd-runner: [GET_SPEC - EVENT] Sending instance spec get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 465 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5692024-08-30T01:15:39.293ZINFOphd-runner: [GET_SPEC - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 463 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5702024-08-30T01:15:39.294ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5712024-08-30T01:15:39.294ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5722024-08-30T01:15:39.294ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
5732024-08-30T01:15:39.294ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 8802 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
5742024-08-30T01:15:39.294ZINFOphd-runner: test phd_tests::migrate::migration_ensures_instance_metadata ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
5752024-08-30T01:15:39.294ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
5762024-08-30T01:15:39.295ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5772024-08-30T01:15:39.295ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::migration_ensures_instance_metadata self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5782024-08-30T01:15:39.419ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 125 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_source vm_id = 94eaf610-1afc-4255-9d2b-dd3588a7ea0a
5792024-08-30T01:15:39.420ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::migration_ensures_instance_metadata self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5802024-08-30T01:15:39.554ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::zfs vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5812024-08-30T01:15:39.554ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-5f28910a-93bf-4fb8-b2c0-8f8d59cfc254"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::zfs verb = destroy vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5822024-08-30T01:15:39.580ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::zfs vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5832024-08-30T01:15:39.580ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-62e3e180-ee29-4700-9ac3-a559b6bc90f2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::zfs verb = destroy vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5842024-08-30T01:15:39.600ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 306 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_framework::test_vm vm = migration_ensures_instance_metadata_target vm_id = 215a7c51-e02f-49ec-913f-645e6a846db7
5852024-08-30T01:15:39.600ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 9679 file = phd-tests/tests/src/migrate.rs line = 402 path = phd_tests::migrate::migration_ensures_instance_metadata target = phd_tests::migrate
5862024-08-30T01:15:39.601ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 306 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
5872024-08-30T01:15:39.601ZINFOphd-runner: Starting test phd_tests::migrate::multiple_migrations file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
5882024-08-30T01:15:39.601ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
5892024-08-30T01:15:39.601ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
5902024-08-30T01:15:39.601ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 318 path = phd_tests::migrate::multiple_migrations target = phd_tests::migrate
5912024-08-30T01:15:39.601ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
5922024-08-30T01:15:39.601ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
5932024-08-30T01:15:39.601ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
5942024-08-30T01:15:39.601ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = list
5952024-08-30T01:15:39.612ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::multiple_migrations stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 51.1M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
5962024-08-30T01:15:39.612ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84592734-b92c-487a-9916-26464728762d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = snapshot
5972024-08-30T01:15:39.628ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84592734-b92c-487a-9916-26464728762d", "phd-artifacts/phd-clone-e06bab99-579a-4816-a9d2-c59207a4555f"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = clone
5982024-08-30T01:15:39.646ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-e06bab99-579a-4816-a9d2-c59207a4555f"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = list
5992024-08-30T01:15:39.656ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::multiple_migrations stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-e06bab99-579a-4816-a9d2-c59207a4555f 0B 1.80T 48.9M /phd-artifacts/phd-clone-e06bab99-579a-4816-a9d2-c59207a4555f\n target = phd_framework::zfs
6002024-08-30T01:15:39.657ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6012024-08-30T01:15:39.657ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm_name = multiple_migrations_0
6022024-08-30T01:15:39.657ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
6032024-08-30T01:15:39.657ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/multiple_migrations_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::multiple_migrations server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
6042024-08-30T01:15:39.657ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::multiple_migrations stderr_path = "/tmp/propolis-phd/multiple_migrations_0.stderr.log" stdout_path = "/tmp/propolis-phd/multiple_migrations_0.stdout.log" target = phd_framework::server_log_mode
6052024-08-30T01:15:39.662ZINFOphd-runner: [NEW - EVENT] Launched server with pid 933 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm::server
6062024-08-30T01:15:39.662ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6072024-08-30T01:15:39.662ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6082024-08-30T01:15:39.662ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm_name = multiple_migrations_1
6092024-08-30T01:15:39.662ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
6102024-08-30T01:15:39.662ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/multiple_migrations_1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::multiple_migrations server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
6112024-08-30T01:15:39.662ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::multiple_migrations stderr_path = "/tmp/propolis-phd/multiple_migrations_1.stderr.log" stdout_path = "/tmp/propolis-phd/multiple_migrations_1.stdout.log" target = phd_framework::server_log_mode
6122024-08-30T01:15:39.668ZINFOphd-runner: [NEW - EVENT] Launched server with pid 934 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm::server
6132024-08-30T01:15:39.668ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6142024-08-30T01:15:39.668ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6152024-08-30T01:15:39.668ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm_name = multiple_migrations_2
6162024-08-30T01:15:39.668ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
6172024-08-30T01:15:39.668ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/multiple_migrations_2.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::multiple_migrations server_addr = 127.0.0.1:9004 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
6182024-08-30T01:15:39.668ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::multiple_migrations stderr_path = "/tmp/propolis-phd/multiple_migrations_2.stderr.log" stdout_path = "/tmp/propolis-phd/multiple_migrations_2.stdout.log" target = phd_framework::server_log_mode
6192024-08-30T01:15:39.673ZINFOphd-runner: [NEW - EVENT] Launched server with pid 935 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm::server
6202024-08-30T01:15:39.674ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6212024-08-30T01:15:39.674ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6222024-08-30T01:15:39.674ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6232024-08-30T01:15:40.173ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
6242024-08-30T01:15:40.174ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 751db8ab-e049-48d2-a70b-a196cc5e043b, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 60ef006d-85fb-494b-93f0-fbcc0a92d0be, silo_id: 4ede32ea-ad88-4068-8e0b-1e330e7a1e62, sled_id: b58c5e7c-8ce7-4c34-ac30-d45f133d02c6, sled_model: "pheidippes", sled_revision: 1, sled_serial: "b58c5e7c-8ce7-4c34-ac30-d45f133d02c6" }, name: "phd-vm-751db8ab-e049-48d2-a70b-a196cc5e043b", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6252024-08-30T01:15:40.174ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 500 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6262024-08-30T01:15:40.175ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6272024-08-30T01:15:40.175ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::multiple_migrations state = Run target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6282024-08-30T01:15:40.175ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6292024-08-30T01:15:40.175ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6302024-08-30T01:15:40.175ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = 300s vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6312024-08-30T01:15:40.175ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::multiple_migrations step = WaitFor("localhost login: ") target = phd_framework::test_vm
6322024-08-30T01:15:40.175ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6332024-08-30T01:15:40.175ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = CallerTimeout vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6342024-08-30T01:15:44.373ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4197 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6352024-08-30T01:15:44.373ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::multiple_migrations step = WriteStr("root") target = phd_framework::test_vm
6362024-08-30T01:15:44.373ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::multiple_migrations step = WaitFor("localhost:~#") target = phd_framework::test_vm
6372024-08-30T01:15:44.373ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6382024-08-30T01:15:44.373ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = CallerTimeout vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6392024-08-30T01:15:44.390ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6402024-08-30T01:15:44.390ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6412024-08-30T01:15:44.390ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4214 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm
6422024-08-30T01:15:44.390ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6432024-08-30T01:15:44.390ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = 8b0f5bdc-ae2f-4f6d-9dbe-b2f346861af5 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0 timeout_duration = 45s
6442024-08-30T01:15:44.390ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0 vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6452024-08-30T01:15:44.508ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 917ce6e8-4153-4d2e-b151-85088580ade0, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 60ef006d-85fb-494b-93f0-fbcc0a92d0be, silo_id: 4ede32ea-ad88-4068-8e0b-1e330e7a1e62, sled_id: e8e3afd8-879f-4857-8051-ea45c338da9c, sled_model: "pheidippes", sled_revision: 1, sled_serial: "e8e3afd8-879f-4857-8051-ea45c338da9c" }, name: "phd-vm-917ce6e8-4153-4d2e-b151-85088580ade0", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0 vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6462024-08-30T01:15:44.509ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 118 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0 vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6472024-08-30T01:15:44.509ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 8b0f5bdc-ae2f-4f6d-9dbe-b2f346861af5 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6482024-08-30T01:15:47.167ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":7609}} target = phd_framework::serial
6492024-08-30T01:15:47.861ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6502024-08-30T01:15:47.861ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 3352 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 8b0f5bdc-ae2f-4f6d-9dbe-b2f346861af5 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6512024-08-30T01:15:47.861ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 3470 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_0 source_id = 751db8ab-e049-48d2-a70b-a196cc5e043b target = phd_framework::test_vm target_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6522024-08-30T01:15:47.861ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6532024-08-30T01:15:47.861ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6542024-08-30T01:15:51.044ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 3182 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6552024-08-30T01:15:51.044ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6562024-08-30T01:15:51.044ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6572024-08-30T01:15:51.067ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6582024-08-30T01:15:51.067ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6592024-08-30T01:15:51.067ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9002 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = fc2b1ea8-5472-4b53-b6ff-68a7a51a45ba path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1 timeout_duration = 45s
6602024-08-30T01:15:51.067ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1 vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6612024-08-30T01:15:51.180ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: e5367b90-c05e-4fa4-b782-b6ef68572aa1, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 60ef006d-85fb-494b-93f0-fbcc0a92d0be, silo_id: 4ede32ea-ad88-4068-8e0b-1e330e7a1e62, sled_id: 117bec64-be19-46bc-a715-293694986fcf, sled_model: "pheidippes", sled_revision: 1, sled_serial: "117bec64-be19-46bc-a715-293694986fcf" }, name: "phd-vm-e5367b90-c05e-4fa4-b782-b6ef68572aa1", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1 vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6622024-08-30T01:15:51.180ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 112 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1 vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6632024-08-30T01:15:51.180ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = fc2b1ea8-5472-4b53-b6ff-68a7a51a45ba path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6642024-08-30T01:15:53.840ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9004","from_start":7657}} target = phd_framework::serial
6652024-08-30T01:15:55.120ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6662024-08-30T01:15:55.120ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 3939 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = fc2b1ea8-5472-4b53-b6ff-68a7a51a45ba path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6672024-08-30T01:15:55.120ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4052 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::multiple_migrations source = multiple_migrations_1 source_id = 917ce6e8-4153-4d2e-b151-85088580ade0 target = phd_framework::test_vm target_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6682024-08-30T01:15:55.120ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6692024-08-30T01:15:55.120ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6702024-08-30T01:15:55.132ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6712024-08-30T01:15:55.132ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6722024-08-30T01:15:55.132ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6732024-08-30T01:15:55.165ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6742024-08-30T01:15:55.165ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6752024-08-30T01:15:55.165ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6762024-08-30T01:15:55.165ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6772024-08-30T01:15:55.165ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
6782024-08-30T01:15:55.165ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 14991 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
6792024-08-30T01:15:55.165ZINFOphd-runner: test phd_tests::migrate::multiple_migrations ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
6802024-08-30T01:15:55.166ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
6812024-08-30T01:15:55.166ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6822024-08-30T01:15:55.167ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::multiple_migrations self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6832024-08-30T01:15:55.167ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::multiple_migrations self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6842024-08-30T01:15:55.282ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 116 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_0 vm_id = 751db8ab-e049-48d2-a70b-a196cc5e043b
6852024-08-30T01:15:55.389ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 223 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_1 vm_id = 917ce6e8-4153-4d2e-b151-85088580ade0
6862024-08-30T01:15:55.821ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::multiple_migrations self.address = 127.0.0.1:9004 target = phd_framework::test_vm::server vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6872024-08-30T01:15:55.927ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6882024-08-30T01:15:55.927ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-e06bab99-579a-4816-a9d2-c59207a4555f"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = destroy vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6892024-08-30T01:15:55.952ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6902024-08-30T01:15:55.953ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-84592734-b92c-487a-9916-26464728762d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::multiple_migrations target = phd_framework::zfs verb = destroy vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6912024-08-30T01:15:55.972ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 806 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::multiple_migrations target = phd_framework::test_vm vm = multiple_migrations_2 vm_id = e5367b90-c05e-4fa4-b782-b6ef68572aa1
6922024-08-30T01:15:55.972ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 16370 file = phd-tests/tests/src/migrate.rs line = 318 path = phd_tests::migrate::multiple_migrations target = phd_tests::migrate
6932024-08-30T01:15:55.972ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 806 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
6942024-08-30T01:15:55.972ZINFOphd-runner: Starting test phd_tests::migrate::incompatible_vms file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
6952024-08-30T01:15:55.972ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
6962024-08-30T01:15:55.972ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
6972024-08-30T01:15:55.972ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 268 path = phd_tests::migrate::incompatible_vms target = phd_tests::migrate
6982024-08-30T01:15:55.972ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
6992024-08-30T01:15:55.973ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7002024-08-30T01:15:55.973ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7012024-08-30T01:15:55.973ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
7022024-08-30T01:15:55.984ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.3M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
7032024-08-30T01:15:55.984ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-55f7dd74-ff12-4212-becd-01be2bdd26da"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = snapshot
7042024-08-30T01:15:56.000ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-55f7dd74-ff12-4212-becd-01be2bdd26da", "phd-artifacts/phd-clone-2f3f869f-d5c2-4259-a17f-c90870f4f9e4"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = clone
7052024-08-30T01:15:56.017ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-2f3f869f-d5c2-4259-a17f-c90870f4f9e4"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
7062024-08-30T01:15:56.027ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-2f3f869f-d5c2-4259-a17f-c90870f4f9e4 0B 1.80T 48.9M /phd-artifacts/phd-clone-2f3f869f-d5c2-4259-a17f-c90870f4f9e4\n target = phd_framework::zfs
7072024-08-30T01:15:56.027ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
7082024-08-30T01:15:56.027ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm_name = migration_incompatible_source_0
7092024-08-30T01:15:56.027ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
7102024-08-30T01:15:56.028ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_incompatible_source_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::incompatible_vms server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
7112024-08-30T01:15:56.028ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::incompatible_vms stderr_path = "/tmp/propolis-phd/migration_incompatible_source_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_incompatible_source_0.stdout.log" target = phd_framework::server_log_mode
7122024-08-30T01:15:56.032ZINFOphd-runner: [NEW - EVENT] Launched server with pid 945 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm::server
7132024-08-30T01:15:56.033ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
7142024-08-30T01:15:56.033ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7152024-08-30T01:15:56.033ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7162024-08-30T01:15:56.449ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
7172024-08-30T01:15:56.450ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: f8ff1ace-2080-4dfc-9546-509bddb2371f, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: ca4cbc85-61cf-48f5-afa4-5337704e277e, silo_id: c7378566-5ef7-4b2e-87e7-28381fb450bb, sled_id: e6ba9a11-190a-42dd-bb76-275105fe556b, sled_model: "pheidippes", sled_revision: 1, sled_serial: "e6ba9a11-190a-42dd-bb76-275105fe556b" }, name: "phd-vm-f8ff1ace-2080-4dfc-9546-509bddb2371f", vcpus: 4 }, state: Creating } line = 387 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7182024-08-30T01:15:56.450ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 416 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7192024-08-30T01:15:56.450ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7202024-08-30T01:15:56.450ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::incompatible_vms state = Run target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7212024-08-30T01:15:56.451ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7222024-08-30T01:15:56.451ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
7232024-08-30T01:15:56.451ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7242024-08-30T01:15:56.451ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7252024-08-30T01:15:56.451ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
7262024-08-30T01:15:56.463ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.9M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
7272024-08-30T01:15:56.464ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-744e88b6-2607-4afa-83b0-a146fb7d0029"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = snapshot
7282024-08-30T01:15:56.483ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-744e88b6-2607-4afa-83b0-a146fb7d0029", "phd-artifacts/phd-clone-478e0d50-592a-41f7-9d20-2ff43942214e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = clone
7292024-08-30T01:15:56.501ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-478e0d50-592a-41f7-9d20-2ff43942214e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
7302024-08-30T01:15:56.512ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-478e0d50-592a-41f7-9d20-2ff43942214e 0B 1.80T 48.9M /phd-artifacts/phd-clone-478e0d50-592a-41f7-9d20-2ff43942214e\n target = phd_framework::zfs
7312024-08-30T01:15:56.513ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
7322024-08-30T01:15:56.513ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm_name = migration_incompatible_target_1
7332024-08-30T01:15:56.513ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
7342024-08-30T01:15:56.513ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_incompatible_target_1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::incompatible_vms server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
7352024-08-30T01:15:56.513ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::incompatible_vms stderr_path = "/tmp/propolis-phd/migration_incompatible_target_1.stderr.log" stdout_path = "/tmp/propolis-phd/migration_incompatible_target_1.stdout.log" target = phd_framework::server_log_mode
7362024-08-30T01:15:56.519ZINFOphd-runner: [NEW - EVENT] Launched server with pid 950 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm::server
7372024-08-30T01:15:56.519ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 6 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
7382024-08-30T01:15:56.519ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = f8ff1ace-2080-4dfc-9546-509bddb2371f target = phd_framework::test_vm target_id = fb334adc-0e76-4068-b6db-e9793c8648fd
7392024-08-30T01:15:56.520ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = cffe6055-7645-44ac-984a-f4c735d91f51 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = f8ff1ace-2080-4dfc-9546-509bddb2371f target = phd_framework::test_vm target_id = fb334adc-0e76-4068-b6db-e9793c8648fd timeout_duration = 45s
7402024-08-30T01:15:56.520ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = f8ff1ace-2080-4dfc-9546-509bddb2371f target = phd_framework::test_vm target_id = fb334adc-0e76-4068-b6db-e9793c8648fd vm = migration_incompatible_target_1 vm_id = fb334adc-0e76-4068-b6db-e9793c8648fd
7412024-08-30T01:15:56.520ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = f8ff1ace-2080-4dfc-9546-509bddb2371f target = phd_framework::test_vm target_id = fb334adc-0e76-4068-b6db-e9793c8648fd vm = migration_incompatible_target_1 vm_id = fb334adc-0e76-4068-b6db-e9793c8648fd
7422024-08-30T01:15:57.035ZERROphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] permanent error from instance_spec_ensure e = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3d7f83bb-7d69-42b4-a661-cc67c9f0dca6", "content-length": "124", "date": "Fri, 30 Aug 2024 01:15:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3d7f83bb-7d69-42b4-a661-cc67c9f0dca6" } file = phd-tests/framework/src/test_vm/mod.rs line = 335 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = f8ff1ace-2080-4dfc-9546-509bddb2371f target = phd_framework::test_vm target_id = fb334adc-0e76-4068-b6db-e9793c8648fd vm = migration_incompatible_target_1 vm_id = fb334adc-0e76-4068-b6db-e9793c8648fd
7432024-08-30T01:15:57.035ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 515 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = f8ff1ace-2080-4dfc-9546-509bddb2371f target = phd_framework::test_vm target_id = fb334adc-0e76-4068-b6db-e9793c8648fd vm = migration_incompatible_target_1 vm_id = fb334adc-0e76-4068-b6db-e9793c8648fd
7442024-08-30T01:15:57.035ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 515 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_0 source_id = f8ff1ace-2080-4dfc-9546-509bddb2371f target = phd_framework::test_vm target_id = fb334adc-0e76-4068-b6db-e9793c8648fd
7452024-08-30T01:15:57.037ZDEBGphd-runner: [TEST - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::incompatible_vms self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server
7462024-08-30T01:15:57.053ZDEBGphd-runner: [TEST - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs
7472024-08-30T01:15:57.053ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-478e0d50-592a-41f7-9d20-2ff43942214e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy
7482024-08-30T01:15:57.085ZDEBGphd-runner: [TEST - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs
7492024-08-30T01:15:57.085ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-744e88b6-2607-4afa-83b0-a146fb7d0029"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy
7502024-08-30T01:15:57.103ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7512024-08-30T01:15:57.103ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
7522024-08-30T01:15:57.103ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7532024-08-30T01:15:57.103ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7542024-08-30T01:15:57.103ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
7552024-08-30T01:15:57.107ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7562024-08-30T01:15:57.114ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.6M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
7572024-08-30T01:15:57.114ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-3a919bbf-b0f8-4183-8954-fc6cd4b70482"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = snapshot
7582024-08-30T01:15:57.129ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-3a919bbf-b0f8-4183-8954-fc6cd4b70482", "phd-artifacts/phd-clone-6339184c-c422-4ed3-abe0-8fc41dc43b8c"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = clone
7592024-08-30T01:15:57.147ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-6339184c-c422-4ed3-abe0-8fc41dc43b8c"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
7602024-08-30T01:15:57.157ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-6339184c-c422-4ed3-abe0-8fc41dc43b8c 0B 1.80T 48.9M /phd-artifacts/phd-clone-6339184c-c422-4ed3-abe0-8fc41dc43b8c\n target = phd_framework::zfs
7612024-08-30T01:15:57.158ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
7622024-08-30T01:15:57.158ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm_name = migration_incompatible_source_1
7632024-08-30T01:15:57.158ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
7642024-08-30T01:15:57.158ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_incompatible_source_1.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::incompatible_vms server_addr = 127.0.0.1:9004 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
7652024-08-30T01:15:57.158ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::incompatible_vms stderr_path = "/tmp/propolis-phd/migration_incompatible_source_1.stderr.log" stdout_path = "/tmp/propolis-phd/migration_incompatible_source_1.stdout.log" target = phd_framework::server_log_mode
7662024-08-30T01:15:57.163ZINFOphd-runner: [NEW - EVENT] Launched server with pid 958 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm::server
7672024-08-30T01:15:57.163ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
7682024-08-30T01:15:57.163ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
7692024-08-30T01:15:57.163ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9004/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
7702024-08-30T01:15:57.164ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
7712024-08-30T01:15:57.164ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 714 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
7722024-08-30T01:15:57.582ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
7732024-08-30T01:15:57.583ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: ecd5de91-91fb-408d-9a22-f120382e7c8b, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: d9d8b54e-0906-4371-9c15-555b4cdd0e38, silo_id: 571fccf4-7b55-4988-966c-68e31bf17680, sled_id: 8f786dad-b715-4c7f-9c42-e11dc9751f00, sled_model: "pheidippes", sled_revision: 1, sled_serial: "8f786dad-b715-4c7f-9c42-e11dc9751f00" }, name: "phd-vm-ecd5de91-91fb-408d-9a22-f120382e7c8b", vcpus: 4 }, state: Creating } line = 387 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
7742024-08-30T01:15:57.583ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 419 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
7752024-08-30T01:15:57.583ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
7762024-08-30T01:15:57.583ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::incompatible_vms state = Run target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
7772024-08-30T01:15:57.584ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
7782024-08-30T01:15:57.584ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
7792024-08-30T01:15:57.584ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7802024-08-30T01:15:57.584ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
7812024-08-30T01:15:57.584ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
7822024-08-30T01:15:57.598ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.5M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
7832024-08-30T01:15:57.598ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84e906a7-065c-4ec3-976d-3fdcc14bd505"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = snapshot
7842024-08-30T01:15:57.617ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84e906a7-065c-4ec3-976d-3fdcc14bd505", "phd-artifacts/phd-clone-b358a9fb-5e3e-44c2-9c25-7104e61c4652"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = clone
7852024-08-30T01:15:57.639ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-b358a9fb-5e3e-44c2-9c25-7104e61c4652"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = list
7862024-08-30T01:15:57.650ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::incompatible_vms stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-b358a9fb-5e3e-44c2-9c25-7104e61c4652 0B 1.80T 48.9M /phd-artifacts/phd-clone-b358a9fb-5e3e-44c2-9c25-7104e61c4652\n target = phd_framework::zfs
7872024-08-30T01:15:57.652ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
7882024-08-30T01:15:57.652ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm_name = migration_incompatible_target_2
7892024-08-30T01:15:57.652ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
7902024-08-30T01:15:57.652ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_incompatible_target_2.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::incompatible_vms server_addr = 127.0.0.1:9006 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
7912024-08-30T01:15:57.652ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::incompatible_vms stderr_path = "/tmp/propolis-phd/migration_incompatible_target_2.stderr.log" stdout_path = "/tmp/propolis-phd/migration_incompatible_target_2.stdout.log" target = phd_framework::server_log_mode
7922024-08-30T01:15:57.657ZINFOphd-runner: [NEW - EVENT] Launched server with pid 963 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm::server
7932024-08-30T01:15:57.657ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm
7942024-08-30T01:15:57.657ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = ecd5de91-91fb-408d-9a22-f120382e7c8b target = phd_framework::test_vm target_id = 63a1b519-1207-4745-abe4-21d379615970
7952024-08-30T01:15:57.657ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9004 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = bcac5763-c214-4179-93ad-feb387e7212b path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = ecd5de91-91fb-408d-9a22-f120382e7c8b target = phd_framework::test_vm target_id = 63a1b519-1207-4745-abe4-21d379615970 timeout_duration = 90s
7962024-08-30T01:15:57.658ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = ecd5de91-91fb-408d-9a22-f120382e7c8b target = phd_framework::test_vm target_id = 63a1b519-1207-4745-abe4-21d379615970 vm = migration_incompatible_target_2 vm_id = 63a1b519-1207-4745-abe4-21d379615970
7972024-08-30T01:15:57.658ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9006/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = ecd5de91-91fb-408d-9a22-f120382e7c8b target = phd_framework::test_vm target_id = 63a1b519-1207-4745-abe4-21d379615970 vm = migration_incompatible_target_2 vm_id = 63a1b519-1207-4745-abe4-21d379615970
7982024-08-30T01:15:57.659ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::incompatible_vms self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
7992024-08-30T01:15:57.780ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
8002024-08-30T01:15:57.780ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-2f3f869f-d5c2-4259-a17f-c90870f4f9e4"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
8012024-08-30T01:15:57.804ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
8022024-08-30T01:15:57.804ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-55f7dd74-ff12-4212-becd-01be2bdd26da"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
8032024-08-30T01:15:57.822ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 718 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_0 vm_id = f8ff1ace-2080-4dfc-9546-509bddb2371f
8042024-08-30T01:15:57.988ZERROphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] permanent error from instance_spec_ensure e = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dae18c45-79a2-4d6c-b2c0-2ee656bbec6d", "content-length": "124", "date": "Fri, 30 Aug 2024 01:15:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dae18c45-79a2-4d6c-b2c0-2ee656bbec6d" } file = phd-tests/framework/src/test_vm/mod.rs line = 335 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = ecd5de91-91fb-408d-9a22-f120382e7c8b target = phd_framework::test_vm target_id = 63a1b519-1207-4745-abe4-21d379615970 vm = migration_incompatible_target_2 vm_id = 63a1b519-1207-4745-abe4-21d379615970
8052024-08-30T01:15:57.988ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 330 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = ecd5de91-91fb-408d-9a22-f120382e7c8b target = phd_framework::test_vm target_id = 63a1b519-1207-4745-abe4-21d379615970 vm = migration_incompatible_target_2 vm_id = 63a1b519-1207-4745-abe4-21d379615970
8062024-08-30T01:15:57.988ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 330 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::incompatible_vms source = migration_incompatible_source_1 source_id = ecd5de91-91fb-408d-9a22-f120382e7c8b target = phd_framework::test_vm target_id = 63a1b519-1207-4745-abe4-21d379615970
8072024-08-30T01:15:57.990ZDEBGphd-runner: [TEST - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::incompatible_vms self.address = 127.0.0.1:9006 target = phd_framework::test_vm::server
8082024-08-30T01:15:58.005ZDEBGphd-runner: [TEST - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs
8092024-08-30T01:15:58.005ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-b358a9fb-5e3e-44c2-9c25-7104e61c4652"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy
8102024-08-30T01:15:58.029ZDEBGphd-runner: [TEST - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs
8112024-08-30T01:15:58.029ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-84e906a7-065c-4ec3-976d-3fdcc14bd505"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy
8122024-08-30T01:15:58.049ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
8132024-08-30T01:15:58.049ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
8142024-08-30T01:15:58.050ZINFOphd-runner: test phd_tests::migrate::incompatible_vms ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
8152024-08-30T01:15:58.050ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
8162024-08-30T01:15:58.050ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 467 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
8172024-08-30T01:15:58.050ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
8182024-08-30T01:15:58.495ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::incompatible_vms self.address = 127.0.0.1:9004 target = phd_framework::test_vm::server vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
8192024-08-30T01:15:58.620ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
8202024-08-30T01:15:58.620ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-6339184c-c422-4ed3-abe0-8fc41dc43b8c"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
8212024-08-30T01:15:58.644ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
8222024-08-30T01:15:58.644ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-3a919bbf-b0f8-4183-8954-fc6cd4b70482"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::incompatible_vms target = phd_framework::zfs verb = destroy vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
8232024-08-30T01:15:58.662ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 612 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::incompatible_vms target = phd_framework::test_vm vm = migration_incompatible_source_1 vm_id = ecd5de91-91fb-408d-9a22-f120382e7c8b
8242024-08-30T01:15:58.662ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 2689 file = phd-tests/tests/src/migrate.rs line = 268 path = phd_tests::migrate::incompatible_vms target = phd_tests::migrate
8252024-08-30T01:15:58.662ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 612 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
8262024-08-30T01:15:58.662ZINFOphd-runner: Starting test phd_tests::migrate::serial_history file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
8272024-08-30T01:15:58.662ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
8282024-08-30T01:15:58.662ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
8292024-08-30T01:15:58.663ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 20 path = phd_tests::migrate::serial_history target = phd_tests::migrate
8302024-08-30T01:15:58.663ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
8312024-08-30T01:15:58.663ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
8322024-08-30T01:15:58.663ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
8332024-08-30T01:15:58.663ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = list
8342024-08-30T01:15:58.674ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::serial_history stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 51.0M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
8352024-08-30T01:15:58.674ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-365d9d34-9282-474c-a20c-9e94b966da07"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = snapshot
8362024-08-30T01:15:58.689ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-365d9d34-9282-474c-a20c-9e94b966da07", "phd-artifacts/phd-clone-96f59a17-4e7f-419b-9ee3-5d7801cfe99e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = clone
8372024-08-30T01:15:58.707ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-96f59a17-4e7f-419b-9ee3-5d7801cfe99e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = list
8382024-08-30T01:15:58.717ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::serial_history stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-96f59a17-4e7f-419b-9ee3-5d7801cfe99e 0B 1.80T 48.9M /phd-artifacts/phd-clone-96f59a17-4e7f-419b-9ee3-5d7801cfe99e\n target = phd_framework::zfs
8392024-08-30T01:15:58.718ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
8402024-08-30T01:15:58.718ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm_name = migration_serial_history
8412024-08-30T01:15:58.718ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
8422024-08-30T01:15:58.718ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_serial_history.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::serial_history server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
8432024-08-30T01:15:58.718ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::serial_history stderr_path = "/tmp/propolis-phd/migration_serial_history.stderr.log" stdout_path = "/tmp/propolis-phd/migration_serial_history.stdout.log" target = phd_framework::server_log_mode
8442024-08-30T01:15:58.723ZINFOphd-runner: [NEW - EVENT] Launched server with pid 977 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::serial_history target = phd_framework::test_vm::server
8452024-08-30T01:15:58.724ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
8462024-08-30T01:15:58.724ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8472024-08-30T01:15:58.724ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8482024-08-30T01:15:59.294ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
8492024-08-30T01:15:59.295ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: afeb828c-cef8-4f19-96b9-611b1c3024fb, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 1245cd39-9c6d-4384-ac75-1130608a1f15, silo_id: 8508443b-3d2a-4a3d-b8d1-b5b70f44d37a, sled_id: 4ee0276d-f708-43a5-b977-c1dacf8c0e25, sled_model: "pheidippes", sled_revision: 1, sled_serial: "4ee0276d-f708-43a5-b977-c1dacf8c0e25" }, name: "phd-vm-afeb828c-cef8-4f19-96b9-611b1c3024fb", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8502024-08-30T01:15:59.295ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 571 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8512024-08-30T01:15:59.295ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8522024-08-30T01:15:59.295ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::serial_history state = Run target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8532024-08-30T01:15:59.296ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8542024-08-30T01:15:59.296ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
8552024-08-30T01:15:59.296ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = 300s vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8562024-08-30T01:15:59.296ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::serial_history step = WaitFor("localhost login: ") target = phd_framework::test_vm
8572024-08-30T01:15:59.296ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8582024-08-30T01:15:59.296ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8592024-08-30T01:16:03.535ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4239 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8602024-08-30T01:16:03.535ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::serial_history step = WriteStr("root") target = phd_framework::test_vm
8612024-08-30T01:16:03.536ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::serial_history step = WaitFor("localhost:~#") target = phd_framework::test_vm
8622024-08-30T01:16:03.536ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8632024-08-30T01:16:03.536ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8642024-08-30T01:16:03.553ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8652024-08-30T01:16:03.553ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
8662024-08-30T01:16:03.553ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4256 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
8672024-08-30T01:16:03.553ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8682024-08-30T01:16:03.553ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8692024-08-30T01:16:03.563ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 9 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8702024-08-30T01:16:03.563ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8712024-08-30T01:16:03.563ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::serial_history target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8722024-08-30T01:16:03.596ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8732024-08-30T01:16:03.601ZINFOphd-runner: [TEST - EVENT] migrating to new Propolis artifact for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 74 path = phd_tests::migrate::serial_history propolis_artifact = __DEFAULT_PROPOLIS target = phd_framework::lifecycle vm_name = migration_serial_history
8742024-08-30T01:16:03.601ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
8752024-08-30T01:16:03.601ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm_name = migration_serial_history_lifecycle_0
8762024-08-30T01:16:03.601ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
8772024-08-30T01:16:03.601ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_serial_history_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::serial_history server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
8782024-08-30T01:16:03.601ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::serial_history stderr_path = "/tmp/propolis-phd/migration_serial_history_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_serial_history_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
8792024-08-30T01:16:03.609ZINFOphd-runner: [NEW - EVENT] Launched server with pid 978 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::serial_history target = phd_framework::test_vm::server
8802024-08-30T01:16:03.610ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::serial_history target = phd_framework::test_vm
8812024-08-30T01:16:03.610ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8822024-08-30T01:16:03.610ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = 3b412570-3818-45f6-a1b7-cb0e707adb46 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee timeout_duration = 45s
8832024-08-30T01:16:03.610ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8842024-08-30T01:16:03.610ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8852024-08-30T01:16:04.406ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: fa3c3b5b-0f78-4483-b699-6043e9c9dbee, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 1245cd39-9c6d-4384-ac75-1130608a1f15, silo_id: 8508443b-3d2a-4a3d-b8d1-b5b70f44d37a, sled_id: 6f484286-f458-4a34-bbb7-fe91a2863542, sled_model: "pheidippes", sled_revision: 1, sled_serial: "6f484286-f458-4a34-bbb7-fe91a2863542" }, name: "phd-vm-fa3c3b5b-0f78-4483-b699-6043e9c9dbee", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8862024-08-30T01:16:04.406ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 795 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8872024-08-30T01:16:04.406ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 3b412570-3818-45f6-a1b7-cb0e707adb46 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8882024-08-30T01:16:07.088ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":7685}} target = phd_framework::serial
8892024-08-30T01:16:08.964ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8902024-08-30T01:16:08.965ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4558 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = 3b412570-3818-45f6-a1b7-cb0e707adb46 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8912024-08-30T01:16:08.965ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 5354 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::serial_history source = migration_serial_history source_id = afeb828c-cef8-4f19-96b9-611b1c3024fb target = phd_framework::test_vm target_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8922024-08-30T01:16:08.966ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8932024-08-30T01:16:08.967ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::serial_history self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8942024-08-30T01:16:09.095ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 128 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history vm_id = afeb828c-cef8-4f19-96b9-611b1c3024fb
8952024-08-30T01:16:09.097ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
8962024-08-30T01:16:09.097ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
8972024-08-30T01:16:09.098ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 9803 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
8982024-08-30T01:16:09.098ZINFOphd-runner: test phd_tests::migrate::serial_history ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
8992024-08-30T01:16:09.098ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
9002024-08-30T01:16:09.098ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
9012024-08-30T01:16:09.824ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::serial_history self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
9022024-08-30T01:16:09.947ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::serial_history target = phd_framework::zfs vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
9032024-08-30T01:16:09.947ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-96f59a17-4e7f-419b-9ee3-5d7801cfe99e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = destroy vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
9042024-08-30T01:16:09.972ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::serial_history target = phd_framework::zfs vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
9052024-08-30T01:16:09.973ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-365d9d34-9282-474c-a20c-9e94b966da07"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::serial_history target = phd_framework::zfs verb = destroy vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
9062024-08-30T01:16:09.993ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 895 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::serial_history target = phd_framework::test_vm vm = migration_serial_history_lifecycle_0 vm_id = fa3c3b5b-0f78-4483-b699-6043e9c9dbee
9072024-08-30T01:16:09.993ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 11330 file = phd-tests/tests/src/migrate.rs line = 20 path = phd_tests::migrate::serial_history target = phd_tests::migrate
9082024-08-30T01:16:09.993ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 895 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
9092024-08-30T01:16:09.993ZINFOphd-runner: Starting test phd_tests::migrate::smoke_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
9102024-08-30T01:16:09.993ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
9112024-08-30T01:16:09.993ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
9122024-08-30T01:16:09.993ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/migrate.rs line = 15 path = phd_tests::migrate::smoke_test target = phd_tests::migrate
9132024-08-30T01:16:09.993ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
9142024-08-30T01:16:09.993ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
9152024-08-30T01:16:09.993ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
9162024-08-30T01:16:09.994ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = list
9172024-08-30T01:16:10.005ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::smoke_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 51.5M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
9182024-08-30T01:16:10.005ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-3adead02-28ab-45d2-8caf-28d82a3d626e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = snapshot
9192024-08-30T01:16:10.020ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-3adead02-28ab-45d2-8caf-28d82a3d626e", "phd-artifacts/phd-clone-95604aa7-0d89-4004-9398-4e281d208579"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = clone
9202024-08-30T01:16:10.039ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-95604aa7-0d89-4004-9398-4e281d208579"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = list
9212024-08-30T01:16:10.050ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::migrate::smoke_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-95604aa7-0d89-4004-9398-4e281d208579 0B 1.80T 48.9M /phd-artifacts/phd-clone-95604aa7-0d89-4004-9398-4e281d208579\n target = phd_framework::zfs
9222024-08-30T01:16:10.050ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
9232024-08-30T01:16:10.051ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm_name = migration_smoke
9242024-08-30T01:16:10.051ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
9252024-08-30T01:16:10.051ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_smoke.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::smoke_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
9262024-08-30T01:16:10.051ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::smoke_test stderr_path = "/tmp/propolis-phd/migration_smoke.stderr.log" stdout_path = "/tmp/propolis-phd/migration_smoke.stdout.log" target = phd_framework::server_log_mode
9272024-08-30T01:16:10.056ZINFOphd-runner: [NEW - EVENT] Launched server with pid 987 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm::server
9282024-08-30T01:16:10.056ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
9292024-08-30T01:16:10.056ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9302024-08-30T01:16:10.057ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9312024-08-30T01:16:10.792ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
9322024-08-30T01:16:10.792ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: e424ae70-cee1-40e1-b800-ab1451cbf8c0, silo_id: 281f3e4b-cd12-41b1-a1fc-dd2833a81a2c, sled_id: f477b3a5-8157-44c1-a325-2ba8f02a0996, sled_model: "pheidippes", sled_revision: 1, sled_serial: "f477b3a5-8157-44c1-a325-2ba8f02a0996" }, name: "phd-vm-bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9332024-08-30T01:16:10.792ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 735 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9342024-08-30T01:16:10.792ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9352024-08-30T01:16:10.792ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::migrate::smoke_test state = Run target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9362024-08-30T01:16:10.793ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9372024-08-30T01:16:10.793ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
9382024-08-30T01:16:10.793ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = 300s vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9392024-08-30T01:16:10.793ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::smoke_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
9402024-08-30T01:16:10.793ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9412024-08-30T01:16:10.793ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9422024-08-30T01:16:14.990ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4197 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9432024-08-30T01:16:14.990ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::smoke_test step = WriteStr("root") target = phd_framework::test_vm
9442024-08-30T01:16:14.991ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::migrate::smoke_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
9452024-08-30T01:16:14.991ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9462024-08-30T01:16:14.991ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9472024-08-30T01:16:15.007ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 15 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9482024-08-30T01:16:15.007ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
9492024-08-30T01:16:15.007ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4213 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
9502024-08-30T01:16:15.007ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9512024-08-30T01:16:15.007ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9522024-08-30T01:16:15.017ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9532024-08-30T01:16:15.018ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9542024-08-30T01:16:15.018ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9552024-08-30T01:16:15.040ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9562024-08-30T01:16:15.040ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9572024-08-30T01:16:15.040ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9582024-08-30T01:16:15.052ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9592024-08-30T01:16:15.052ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9602024-08-30T01:16:15.052ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9612024-08-30T01:16:15.085ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9622024-08-30T01:16:15.085ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9632024-08-30T01:16:15.085ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9642024-08-30T01:16:15.095ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9652024-08-30T01:16:15.096ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9662024-08-30T01:16:15.096ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9672024-08-30T01:16:15.129ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9682024-08-30T01:16:15.129ZINFOphd-runner: [TEST - EVENT] migrating to new Propolis artifact for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 74 path = phd_tests::migrate::smoke_test propolis_artifact = __DEFAULT_PROPOLIS target = phd_framework::lifecycle vm_name = migration_smoke
9692024-08-30T01:16:15.129ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
9702024-08-30T01:16:15.129ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm_name = migration_smoke_lifecycle_0
9712024-08-30T01:16:15.129ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
9722024-08-30T01:16:15.130ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/migration_smoke_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::migrate::smoke_test server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
9732024-08-30T01:16:15.130ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::migrate::smoke_test stderr_path = "/tmp/propolis-phd/migration_smoke_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/migration_smoke_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
9742024-08-30T01:16:15.136ZINFOphd-runner: [NEW - EVENT] Launched server with pid 988 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm::server
9752024-08-30T01:16:15.137ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 7 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm
9762024-08-30T01:16:15.137ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9772024-08-30T01:16:15.137ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = dfa741de-48ac-4500-9ba8-f0bfbd0d69d7 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b timeout_duration = 45s
9782024-08-30T01:16:15.137ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9792024-08-30T01:16:15.137ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9802024-08-30T01:16:15.650ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: e2445bd2-4730-44cb-9f37-590b2fdf794b, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: e424ae70-cee1-40e1-b800-ab1451cbf8c0, silo_id: 281f3e4b-cd12-41b1-a1fc-dd2833a81a2c, sled_id: c5f7e1b1-0cbb-4c9e-9689-1a2aefd8edcc, sled_model: "pheidippes", sled_revision: 1, sled_serial: "c5f7e1b1-0cbb-4c9e-9689-1a2aefd8edcc" }, name: "phd-vm-e2445bd2-4730-44cb-9f37-590b2fdf794b", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9812024-08-30T01:16:15.650ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 513 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9822024-08-30T01:16:15.651ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = dfa741de-48ac-4500-9ba8-f0bfbd0d69d7 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9832024-08-30T01:16:18.335ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9002","from_start":7718}} target = phd_framework::serial
9842024-08-30T01:16:20.129ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9852024-08-30T01:16:20.129ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 4478 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = dfa741de-48ac-4500-9ba8-f0bfbd0d69d7 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9862024-08-30T01:16:20.129ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4992 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::migrate::smoke_test source = migration_smoke source_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4 target = phd_framework::test_vm target_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9872024-08-30T01:16:20.131ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9882024-08-30T01:16:20.131ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9892024-08-30T01:16:20.131ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9902024-08-30T01:16:20.132ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::smoke_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9912024-08-30T01:16:20.258ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 126 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke vm_id = bfd58044-1b5a-49dc-ad06-f7e7bdcdb1f4
9922024-08-30T01:16:20.258ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 126 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9932024-08-30T01:16:20.259ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9942024-08-30T01:16:20.259ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9952024-08-30T01:16:20.281ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9962024-08-30T01:16:20.281ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
9972024-08-30T01:16:20.281ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
9982024-08-30T01:16:20.282ZINFOphd-runner: test phd_tests::migrate::smoke_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
9992024-08-30T01:16:20.282ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 9489 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
10002024-08-30T01:16:20.282ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
10012024-08-30T01:16:20.282ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
10022024-08-30T01:16:20.982ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::migrate::smoke_test self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
10032024-08-30T01:16:21.113ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::migrate::smoke_test target = phd_framework::zfs vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
10042024-08-30T01:16:21.113ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-95604aa7-0d89-4004-9398-4e281d208579"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = destroy vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
10052024-08-30T01:16:21.139ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::migrate::smoke_test target = phd_framework::zfs vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
10062024-08-30T01:16:21.139ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-3adead02-28ab-45d2-8caf-28d82a3d626e"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::migrate::smoke_test target = phd_framework::zfs verb = destroy vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
10072024-08-30T01:16:21.157ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 875 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::migrate::smoke_test target = phd_framework::test_vm vm = migration_smoke_lifecycle_0 vm_id = e2445bd2-4730-44cb-9f37-590b2fdf794b
10082024-08-30T01:16:21.158ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 11164 file = phd-tests/tests/src/migrate.rs line = 15 path = phd_tests::migrate::smoke_test target = phd_tests::migrate
10092024-08-30T01:16:21.158ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 876 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
10102024-08-30T01:16:21.158ZINFOphd-runner: Starting test phd_tests::hw::lspci_lifecycle_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
10112024-08-30T01:16:21.158ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
10122024-08-30T01:16:21.158ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
10132024-08-30T01:16:21.158ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/hw.rs line = 8 path = phd_tests::hw::lspci_lifecycle_test target = phd_tests::hw
10142024-08-30T01:16:21.158ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
10152024-08-30T01:16:21.158ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
10162024-08-30T01:16:21.158ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
10172024-08-30T01:16:21.158ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = list
10182024-08-30T01:16:21.170ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::hw::lspci_lifecycle_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.3M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
10192024-08-30T01:16:21.170ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-4b14fbf3-d1d9-472d-bcbe-2a6b1749f1e4"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = snapshot
10202024-08-30T01:16:21.185ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-4b14fbf3-d1d9-472d-bcbe-2a6b1749f1e4", "phd-artifacts/phd-clone-b24d1606-a4e6-41f2-a3b7-7cd83b09abd2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = clone
10212024-08-30T01:16:21.201ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-b24d1606-a4e6-41f2-a3b7-7cd83b09abd2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = list
10222024-08-30T01:16:21.211ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::hw::lspci_lifecycle_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-b24d1606-a4e6-41f2-a3b7-7cd83b09abd2 0B 1.80T 48.9M /phd-artifacts/phd-clone-b24d1606-a4e6-41f2-a3b7-7cd83b09abd2\n target = phd_framework::zfs
10232024-08-30T01:16:21.211ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10242024-08-30T01:16:21.211ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm_name = lspci_lifecycle_test
10252024-08-30T01:16:21.211ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
10262024-08-30T01:16:21.211ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/lspci_lifecycle_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::hw::lspci_lifecycle_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
10272024-08-30T01:16:21.211ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::hw::lspci_lifecycle_test stderr_path = "/tmp/propolis-phd/lspci_lifecycle_test.stderr.log" stdout_path = "/tmp/propolis-phd/lspci_lifecycle_test.stdout.log" target = phd_framework::server_log_mode
10282024-08-30T01:16:21.216ZINFOphd-runner: [NEW - EVENT] Launched server with pid 997 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm::server
10292024-08-30T01:16:21.216ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10302024-08-30T01:16:21.216ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10312024-08-30T01:16:21.217ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10322024-08-30T01:16:22.036ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
10332024-08-30T01:16:22.036ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 917314f2-9e4e-4c37-96cb-673c2396a337, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: b4d2e25c-e744-48fc-b7de-0c5c525b244c, silo_id: 4e463a56-a53f-4743-be7b-3113324c8c16, sled_id: 5f41e2d1-eab4-471e-8317-0cf3ebd82068, sled_model: "pheidippes", sled_revision: 1, sled_serial: "5f41e2d1-eab4-471e-8317-0cf3ebd82068" }, name: "phd-vm-917314f2-9e4e-4c37-96cb-673c2396a337", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10342024-08-30T01:16:22.037ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 820 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10352024-08-30T01:16:22.037ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10362024-08-30T01:16:22.037ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::hw::lspci_lifecycle_test state = Run target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10372024-08-30T01:16:22.037ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10382024-08-30T01:16:22.037ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10392024-08-30T01:16:22.037ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = 300s vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10402024-08-30T01:16:22.037ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::hw::lspci_lifecycle_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
10412024-08-30T01:16:22.037ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10422024-08-30T01:16:22.037ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10432024-08-30T01:16:26.239ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4201 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10442024-08-30T01:16:26.240ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::hw::lspci_lifecycle_test step = WriteStr("root") target = phd_framework::test_vm
10452024-08-30T01:16:26.240ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::hw::lspci_lifecycle_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
10462024-08-30T01:16:26.240ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10472024-08-30T01:16:26.240ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10482024-08-30T01:16:26.256ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 15 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10492024-08-30T01:16:26.256ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10502024-08-30T01:16:26.256ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4218 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10512024-08-30T01:16:26.256ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10522024-08-30T01:16:26.256ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10532024-08-30T01:16:26.266ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10542024-08-30T01:16:26.267ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10552024-08-30T01:16:26.267ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10562024-08-30T01:16:26.300ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10572024-08-30T01:16:26.300ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10582024-08-30T01:16:26.300ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10592024-08-30T01:16:26.310ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10602024-08-30T01:16:26.311ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10612024-08-30T01:16:26.311ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10622024-08-30T01:16:26.344ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10632024-08-30T01:16:26.344ZINFOphd-runner: [TEST - EVENT] stopping and starting VM for lifecycle test file = phd-tests/framework/src/lifecycle.rs line = 58 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::lifecycle vm_name = lspci_lifecycle_test
10642024-08-30T01:16:26.344ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10652024-08-30T01:16:26.344ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::hw::lspci_lifecycle_test state = Stop target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10662024-08-30T01:16:26.345ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10672024-08-30T01:16:26.345ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10682024-08-30T01:16:26.345ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm_name = lspci_lifecycle_test_lifecycle_0
10692024-08-30T01:16:26.345ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
10702024-08-30T01:16:26.345ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::hw::lspci_lifecycle_test server_addr = 127.0.0.1:9002 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
10712024-08-30T01:16:26.345ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::hw::lspci_lifecycle_test stderr_path = "/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stderr.log" stdout_path = "/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stdout.log" target = phd_framework::server_log_mode
10722024-08-30T01:16:26.352ZINFOphd-runner: [NEW - EVENT] Launched server with pid 998 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm::server
10732024-08-30T01:16:26.353ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 7 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10742024-08-30T01:16:26.353ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10752024-08-30T01:16:26.353ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10762024-08-30T01:16:26.353ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
10772024-08-30T01:16:26.353ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4317 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
10782024-08-30T01:16:26.835ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
10792024-08-30T01:16:26.836ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 050c5c98-5bea-4472-acf7-bae87fff3f52, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: b4d2e25c-e744-48fc-b7de-0c5c525b244c, silo_id: 4e463a56-a53f-4743-be7b-3113324c8c16, sled_id: ef21029f-c8f3-4126-9e1a-035e883496d2, sled_model: "pheidippes", sled_revision: 1, sled_serial: "ef21029f-c8f3-4126-9e1a-035e883496d2" }, name: "phd-vm-050c5c98-5bea-4472-acf7-bae87fff3f52", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10802024-08-30T01:16:26.836ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 483 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10812024-08-30T01:16:26.836ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10822024-08-30T01:16:26.837ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::hw::lspci_lifecycle_test state = Run target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10832024-08-30T01:16:26.837ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10842024-08-30T01:16:26.837ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10852024-08-30T01:16:26.837ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = 300s vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10862024-08-30T01:16:26.837ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::hw::lspci_lifecycle_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
10872024-08-30T01:16:26.837ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10882024-08-30T01:16:26.837ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10892024-08-30T01:16:31.040ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4203 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10902024-08-30T01:16:31.041ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::hw::lspci_lifecycle_test step = WriteStr("root") target = phd_framework::test_vm
10912024-08-30T01:16:31.041ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::hw::lspci_lifecycle_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
10922024-08-30T01:16:31.041ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10932024-08-30T01:16:31.041ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10942024-08-30T01:16:31.058ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10952024-08-30T01:16:31.058ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10962024-08-30T01:16:31.058ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4220 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm
10972024-08-30T01:16:31.058ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
10982024-08-30T01:16:31.058ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
10992024-08-30T01:16:31.058ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11002024-08-30T01:16:31.059ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::hw::lspci_lifecycle_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
11012024-08-30T01:16:31.185ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 126 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test vm_id = 917314f2-9e4e-4c37-96cb-673c2396a337
11022024-08-30T01:16:31.185ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 127 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11032024-08-30T01:16:31.186ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11042024-08-30T01:16:31.186ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11052024-08-30T01:16:31.208ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11062024-08-30T01:16:31.208ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11072024-08-30T01:16:31.209ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11082024-08-30T01:16:31.219ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11092024-08-30T01:16:31.219ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11102024-08-30T01:16:31.219ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11112024-08-30T01:16:31.252ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11122024-08-30T01:16:31.252ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11132024-08-30T01:16:31.252ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
11142024-08-30T01:16:31.252ZINFOphd-runner: test phd_tests::hw::lspci_lifecycle_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
11152024-08-30T01:16:31.252ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4417 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
11162024-08-30T01:16:31.253ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
11172024-08-30T01:16:31.253ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11182024-08-30T01:16:31.849ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::hw::lspci_lifecycle_test self.address = 127.0.0.1:9002 target = phd_framework::test_vm::server vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11192024-08-30T01:16:31.983ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11202024-08-30T01:16:31.983ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-b24d1606-a4e6-41f2-a3b7-7cd83b09abd2"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = destroy vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11212024-08-30T01:16:32.008ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11222024-08-30T01:16:32.008ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-4b14fbf3-d1d9-472d-bcbe-2a6b1749f1e4"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::zfs verb = destroy vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11232024-08-30T01:16:32.026ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 774 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::hw::lspci_lifecycle_test target = phd_framework::test_vm vm = lspci_lifecycle_test_lifecycle_0 vm_id = 050c5c98-5bea-4472-acf7-bae87fff3f52
11242024-08-30T01:16:32.027ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 10868 file = phd-tests/tests/src/hw.rs line = 8 path = phd_tests::hw::lspci_lifecycle_test target = phd_tests::hw
11252024-08-30T01:16:32.027ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 774 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
11262024-08-30T01:16:32.027ZINFOphd-runner: Starting test phd_tests::disk::in_memory_backend_smoke_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
11272024-08-30T01:16:32.027ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
11282024-08-30T01:16:32.027ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
11292024-08-30T01:16:32.027ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/disk.rs line = 12 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_tests::disk
11302024-08-30T01:16:32.027ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
11312024-08-30T01:16:32.027ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
11322024-08-30T01:16:32.027ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
11332024-08-30T01:16:32.027ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::zfs verb = list
11342024-08-30T01:16:32.039ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::disk::in_memory_backend_smoke_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.9M 1.80T 48.9M /phd-artifacts\n target = phd_framework::zfs
11352024-08-30T01:16:32.039ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-8979c175-83d3-4255-9f7b-9744decbb974"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::zfs verb = snapshot
11362024-08-30T01:16:32.058ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-8979c175-83d3-4255-9f7b-9744decbb974", "phd-artifacts/phd-clone-b4ca245a-27c4-467e-9c85-7943f027d082"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::zfs verb = clone
11372024-08-30T01:16:32.075ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-b4ca245a-27c4-467e-9c85-7943f027d082"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::zfs verb = list
11382024-08-30T01:16:32.086ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::disk::in_memory_backend_smoke_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-b4ca245a-27c4-467e-9c85-7943f027d082 0B 1.80T 48.9M /phd-artifacts/phd-clone-b4ca245a-27c4-467e-9c85-7943f027d082\n target = phd_framework::zfs
11392024-08-30T01:16:32.087ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm
11402024-08-30T01:16:32.087ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm_name = in_memory_backend_test
11412024-08-30T01:16:32.087ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
11422024-08-30T01:16:32.087ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/in_memory_backend_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::disk::in_memory_backend_smoke_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
11432024-08-30T01:16:32.087ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::disk::in_memory_backend_smoke_test stderr_path = "/tmp/propolis-phd/in_memory_backend_test.stderr.log" stdout_path = "/tmp/propolis-phd/in_memory_backend_test.stdout.log" target = phd_framework::server_log_mode
11442024-08-30T01:16:32.093ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1007 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm::server
11452024-08-30T01:16:32.093ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm
11462024-08-30T01:16:32.093ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11472024-08-30T01:16:32.094ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11482024-08-30T01:16:32.595ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
11492024-08-30T01:16:32.596ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 20cbe522-c753-4f21-b0e4-332da590b352, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: d544d445-b207-4ea0-937b-cfc0041d31b8, silo_id: e18652e9-26ae-4139-91bc-a82261803ca4, sled_id: 1d12e68c-a761-4597-94cb-78c0b8f4b9df, sled_model: "pheidippes", sled_revision: 1, sled_serial: "1d12e68c-a761-4597-94cb-78c0b8f4b9df" }, name: "phd-vm-20cbe522-c753-4f21-b0e4-332da590b352", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11502024-08-30T01:16:32.596ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 503 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11512024-08-30T01:16:32.596ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11522024-08-30T01:16:32.596ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::disk::in_memory_backend_smoke_test state = Run target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11532024-08-30T01:16:32.597ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11542024-08-30T01:16:32.597ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm
11552024-08-30T01:16:32.597ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = 300s vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11562024-08-30T01:16:32.597ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::disk::in_memory_backend_smoke_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
11572024-08-30T01:16:32.597ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11582024-08-30T01:16:32.597ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11592024-08-30T01:16:36.867ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4270 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11602024-08-30T01:16:36.868ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::disk::in_memory_backend_smoke_test step = WriteStr("root") target = phd_framework::test_vm
11612024-08-30T01:16:36.868ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::disk::in_memory_backend_smoke_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
11622024-08-30T01:16:36.868ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11632024-08-30T01:16:36.868ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11642024-08-30T01:16:36.885ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 17 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11652024-08-30T01:16:36.885ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm
11662024-08-30T01:16:36.885ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4288 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm
11672024-08-30T01:16:36.885ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11682024-08-30T01:16:36.885ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11692024-08-30T01:16:36.895ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 9 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11702024-08-30T01:16:36.895ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11712024-08-30T01:16:36.895ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11722024-08-30T01:16:36.928ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11732024-08-30T01:16:36.928ZWARNphd-runner: [TEST - EVENT] guest doesn't support /dev/disk/by-path, did not verify device path file = phd-tests/tests/src/disk.rs line = 45 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_tests::disk
11742024-08-30T01:16:36.928ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11752024-08-30T01:16:36.928ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11762024-08-30T01:16:36.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11772024-08-30T01:16:36.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11782024-08-30T01:16:36.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11792024-08-30T01:16:36.962ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11802024-08-30T01:16:36.962ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11812024-08-30T01:16:36.962ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11822024-08-30T01:16:36.972ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11832024-08-30T01:16:36.972ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11842024-08-30T01:16:36.973ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11852024-08-30T01:16:37.005ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11862024-08-30T01:16:37.005ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11872024-08-30T01:16:37.006ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11882024-08-30T01:16:37.016ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11892024-08-30T01:16:37.016ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11902024-08-30T01:16:37.016ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11912024-08-30T01:16:37.039ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 22 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11922024-08-30T01:16:37.039ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11932024-08-30T01:16:37.039ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11942024-08-30T01:16:37.049ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11952024-08-30T01:16:37.049ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11962024-08-30T01:16:37.049ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11972024-08-30T01:16:37.082ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11982024-08-30T01:16:37.082ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
11992024-08-30T01:16:37.083ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
12002024-08-30T01:16:37.083ZINFOphd-runner: test phd_tests::disk::in_memory_backend_smoke_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
12012024-08-30T01:16:37.083ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4487 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
12022024-08-30T01:16:37.083ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
12032024-08-30T01:16:37.084ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
12042024-08-30T01:16:37.674ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::disk::in_memory_backend_smoke_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
12052024-08-30T01:16:37.801ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::zfs vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
12062024-08-30T01:16:37.801ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-b4ca245a-27c4-467e-9c85-7943f027d082"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::zfs verb = destroy vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
12072024-08-30T01:16:37.832ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::zfs vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
12082024-08-30T01:16:37.832ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-8979c175-83d3-4255-9f7b-9744decbb974"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::zfs verb = destroy vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
12092024-08-30T01:16:37.851ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 768 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_framework::test_vm vm = in_memory_backend_test vm_id = 20cbe522-c753-4f21-b0e4-332da590b352
12102024-08-30T01:16:37.851ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 5824 file = phd-tests/tests/src/disk.rs line = 12 path = phd_tests::disk::in_memory_backend_smoke_test target = phd_tests::disk
12112024-08-30T01:16:37.852ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 768 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
12122024-08-30T01:16:37.852ZINFOphd-runner: Starting test phd_tests::crucible::smoke::shutdown_persistence_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
12132024-08-30T01:16:37.852ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
12142024-08-30T01:16:37.852ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
12152024-08-30T01:16:37.852ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/smoke.rs line = 46 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_tests::crucible::smoke
12162024-08-30T01:16:37.852ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
12172024-08-30T01:16:37.852ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
12182024-08-30T01:16:37.852ZDEBGphd-runner: [TEST - EVENT] checking for existing copy of artifact file = phd-tests/framework/src/artifacts/store.rs line = 89 maybe_path = /phd-artifacts/381af7d19fb0edf80fb98eba86749602a8784ae79c5a04e0a27020df1a2ec079/crucible-nightly.tar.gz path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store
12192024-08-30T01:16:37.852ZDEBGphd-runner: [TEST - EVENT] Downloading file from Buildomat... file = phd-tests/framework/src/artifacts/buildomat.rs line = 215 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::buildomat timeout = 600s uri = https://buildomat.eng.oxide.computer/public/file/oxidecomputer/crucible/nightly-image/d037eeb9a56a8a62ff17266f340c011224d15146/crucible-nightly.tar.gz
12202024-08-30T01:16:52.028ZDEBGphd-runner: [TEST - EVENT] Extracting artifact from tarball extracted_path = /phd-artifacts/381af7d19fb0edf80fb98eba86749602a8784ae79c5a04e0a27020df1a2ec079/crucible-downstairs file = phd-tests/framework/src/artifacts/store.rs line = 162 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store untar_path = target/release/crucible-downstairs
12212024-08-30T01:16:52.028ZDEBGphd-runner: [TEST - EVENT] Extracting gzipped tarball... file = phd-tests/framework/src/artifacts/store.rs line = 518 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::artifacts::store
12222024-08-30T01:16:57.120ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
12232024-08-30T01:16:57.120ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9000", "--encrypted", "--uuid", "44eaf79f-cd04-4f84-b58a-196053a76d7a", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12242024-08-30T01:16:57.200ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::shutdown_persistence_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.159989096Z","hostname":"buskin","pid":1011}\n{"msg":"UUID: 44eaf79f-cd04-4f84-b58a-196053a76d7a","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.192500753Z","hostname":"buskin","pid":1011}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.192510933Z","hostname":"buskin","pid":1011}\n target = phd_framework::disk::crucible
12252024-08-30T01:16:57.200ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9001", "--encrypted", "--uuid", "44eaf79f-cd04-4f84-b58a-196053a76d7a", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12262024-08-30T01:16:57.254ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::shutdown_persistence_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.217830412Z","hostname":"buskin","pid":1012}\n{"msg":"UUID: 44eaf79f-cd04-4f84-b58a-196053a76d7a","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.248120678Z","hostname":"buskin","pid":1012}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.248131248Z","hostname":"buskin","pid":1012}\n target = phd_framework::disk::crucible
12272024-08-30T01:16:57.255ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9002", "--encrypted", "--uuid", "44eaf79f-cd04-4f84-b58a-196053a76d7a", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12282024-08-30T01:16:57.307ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::shutdown_persistence_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.269437466Z","hostname":"buskin","pid":1013}\n{"msg":"UUID: 44eaf79f-cd04-4f84-b58a-196053a76d7a","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.300481383Z","hostname":"buskin","pid":1013}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.300497093Z","hostname":"buskin","pid":1013}\n target = phd_framework::disk::crucible
12292024-08-30T01:16:57.307ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::shutdown_persistence_test stderr_path = "/tmp/propolis-phd/crucible_44eaf79f-cd04-4f84-b58a-196053a76d7a_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_44eaf79f-cd04-4f84-b58a-196053a76d7a_9000.stdout.log" target = phd_framework::server_log_mode
12302024-08-30T01:16:57.307ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12312024-08-30T01:16:57.307ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12322024-08-30T01:16:57.315ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::shutdown_persistence_test stderr_path = "/tmp/propolis-phd/crucible_44eaf79f-cd04-4f84-b58a-196053a76d7a_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_44eaf79f-cd04-4f84-b58a-196053a76d7a_9001.stdout.log" target = phd_framework::server_log_mode
12332024-08-30T01:16:57.316ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12342024-08-30T01:16:57.316ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12352024-08-30T01:16:57.324ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::shutdown_persistence_test stderr_path = "/tmp/propolis-phd/crucible_44eaf79f-cd04-4f84-b58a-196053a76d7a_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_44eaf79f-cd04-4f84-b58a-196053a76d7a_9002.stdout.log" target = phd_framework::server_log_mode
12362024-08-30T01:16:57.324ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12372024-08-30T01:16:57.324ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::disk::crucible
12382024-08-30T01:16:57.331ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::test_vm
12392024-08-30T01:16:57.331ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::test_vm vm_name = crucible_shutdown_persistence_test
12402024-08-30T01:16:57.331ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
12412024-08-30T01:16:57.331ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_shutdown_persistence_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::smoke::shutdown_persistence_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
12422024-08-30T01:16:57.332ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::shutdown_persistence_test stderr_path = "/tmp/propolis-phd/crucible_shutdown_persistence_test.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_shutdown_persistence_test.stdout.log" target = phd_framework::server_log_mode
12432024-08-30T01:16:57.339ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1017 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::test_vm::server
12442024-08-30T01:16:57.339ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_framework::test_vm
12452024-08-30T01:16:57.340ZDEBGphd-runner: [TEST - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::smoke::shutdown_persistence_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server
12462024-08-30T01:16:57.353ZINFOphd-runner: [TEST - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::shutdown_persistence_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9000" } } target = phd_framework::disk::crucible
12472024-08-30T01:16:57.360ZINFOphd-runner: [TEST - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::shutdown_persistence_test self.path = "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9000" target = phd_framework::disk::crucible
12482024-08-30T01:16:57.367ZINFOphd-runner: [TEST - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::shutdown_persistence_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9001" } } target = phd_framework::disk::crucible
12492024-08-30T01:16:57.375ZINFOphd-runner: [TEST - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::shutdown_persistence_test self.path = "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9001" target = phd_framework::disk::crucible
12502024-08-30T01:16:57.382ZINFOphd-runner: [TEST - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::shutdown_persistence_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9002" } } target = phd_framework::disk::crucible
12512024-08-30T01:16:57.390ZINFOphd-runner: [TEST - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::shutdown_persistence_test self.path = "/tmp/propolis-phd/44eaf79f-cd04-4f84-b58a-196053a76d7a_9002" target = phd_framework::disk::crucible
12522024-08-30T01:16:57.398ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 19545 file = phd-tests/tests/src/crucible/smoke.rs line = 46 path = phd_tests::crucible::smoke::shutdown_persistence_test target = phd_tests::crucible::smoke
12532024-08-30T01:16:57.398ZINFOphd-runner: test phd_tests::crucible::smoke::shutdown_persistence_test ... skipped: Can't run data persistence test on a guest with a read-only file system file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
12542024-08-30T01:16:57.398ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
12552024-08-30T01:16:57.399ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
12562024-08-30T01:16:57.399ZINFOphd-runner: Starting test phd_tests::crucible::smoke::guest_reboot_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
12572024-08-30T01:16:57.399ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
12582024-08-30T01:16:57.399ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
12592024-08-30T01:16:57.399ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/smoke.rs line = 31 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_tests::crucible::smoke
12602024-08-30T01:16:57.399ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
12612024-08-30T01:16:57.399ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
12622024-08-30T01:16:57.399ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/381af7d19fb0edf80fb98eba86749602a8784ae79c5a04e0a27020df1a2ec079/crucible-downstairs target = phd_framework::artifacts::store
12632024-08-30T01:16:57.399ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
12642024-08-30T01:16:57.399ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9000", "--encrypted", "--uuid", "b5e57de4-4603-4f57-a5c7-d9ee5d060424", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12652024-08-30T01:16:57.458ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::guest_reboot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.417523733Z","hostname":"buskin","pid":1019}\n{"msg":"UUID: b5e57de4-4603-4f57-a5c7-d9ee5d060424","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.450870973Z","hostname":"buskin","pid":1019}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.450886083Z","hostname":"buskin","pid":1019}\n target = phd_framework::disk::crucible
12662024-08-30T01:16:57.458ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9001", "--encrypted", "--uuid", "b5e57de4-4603-4f57-a5c7-d9ee5d060424", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12672024-08-30T01:16:57.515ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::guest_reboot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.475626876Z","hostname":"buskin","pid":1020}\n{"msg":"UUID: b5e57de4-4603-4f57-a5c7-d9ee5d060424","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.507112935Z","hostname":"buskin","pid":1020}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.507129306Z","hostname":"buskin","pid":1020}\n target = phd_framework::disk::crucible
12682024-08-30T01:16:57.515ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9002", "--encrypted", "--uuid", "b5e57de4-4603-4f57-a5c7-d9ee5d060424", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12692024-08-30T01:16:57.570ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::guest_reboot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.531225281Z","hostname":"buskin","pid":1021}\n{"msg":"UUID: b5e57de4-4603-4f57-a5c7-d9ee5d060424","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.562424912Z","hostname":"buskin","pid":1021}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:16:57.562438512Z","hostname":"buskin","pid":1021}\n target = phd_framework::disk::crucible
12702024-08-30T01:16:57.570ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::guest_reboot_test stderr_path = "/tmp/propolis-phd/crucible_b5e57de4-4603-4f57-a5c7-d9ee5d060424_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_b5e57de4-4603-4f57-a5c7-d9ee5d060424_9000.stdout.log" target = phd_framework::server_log_mode
12712024-08-30T01:16:57.570ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12722024-08-30T01:16:57.570ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12732024-08-30T01:16:57.578ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::guest_reboot_test stderr_path = "/tmp/propolis-phd/crucible_b5e57de4-4603-4f57-a5c7-d9ee5d060424_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_b5e57de4-4603-4f57-a5c7-d9ee5d060424_9001.stdout.log" target = phd_framework::server_log_mode
12742024-08-30T01:16:57.578ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12752024-08-30T01:16:57.578ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12762024-08-30T01:16:57.587ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::guest_reboot_test stderr_path = "/tmp/propolis-phd/crucible_b5e57de4-4603-4f57-a5c7-d9ee5d060424_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_b5e57de4-4603-4f57-a5c7-d9ee5d060424_9002.stdout.log" target = phd_framework::server_log_mode
12772024-08-30T01:16:57.587ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12782024-08-30T01:16:57.587ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::disk::crucible
12792024-08-30T01:16:57.595ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm
12802024-08-30T01:16:57.595ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm_name = crucible_guest_reboot_test
12812024-08-30T01:16:57.595ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
12822024-08-30T01:16:57.595ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_guest_reboot_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::smoke::guest_reboot_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
12832024-08-30T01:16:57.595ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::guest_reboot_test stderr_path = "/tmp/propolis-phd/crucible_guest_reboot_test.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_guest_reboot_test.stdout.log" target = phd_framework::server_log_mode
12842024-08-30T01:16:57.603ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1025 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm::server
12852024-08-30T01:16:57.604ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm
12862024-08-30T01:16:57.604ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12872024-08-30T01:16:57.604ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12882024-08-30T01:16:58.073ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
12892024-08-30T01:16:58.073ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 9b997479-8b24-412a-b353-7f19ad364858, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 0bf43bb4-c8ab-4cd7-96ad-ec032234918e, silo_id: f3e69fbc-e002-4508-90dd-4e8c00372fad, sled_id: d00d14b5-07b4-4eb7-8ef4-ed2db5cd7056, sled_model: "pheidippes", sled_revision: 1, sled_serial: "d00d14b5-07b4-4eb7-8ef4-ed2db5cd7056" }, name: "phd-vm-9b997479-8b24-412a-b353-7f19ad364858", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12902024-08-30T01:16:58.073ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 469 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12912024-08-30T01:16:58.074ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12922024-08-30T01:16:58.074ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::crucible::smoke::guest_reboot_test state = Run target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12932024-08-30T01:16:58.074ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12942024-08-30T01:16:58.074ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm
12952024-08-30T01:16:58.074ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12962024-08-30T01:16:58.074ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::guest_reboot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
12972024-08-30T01:16:58.074ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12982024-08-30T01:16:58.074ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
12992024-08-30T01:17:02.745ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4670 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13002024-08-30T01:17:02.745ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::guest_reboot_test step = WriteStr("root") target = phd_framework::test_vm
13012024-08-30T01:17:02.745ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::guest_reboot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
13022024-08-30T01:17:02.745ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13032024-08-30T01:17:02.745ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13042024-08-30T01:17:02.762ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13052024-08-30T01:17:02.762ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm
13062024-08-30T01:17:02.762ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4687 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm
13072024-08-30T01:17:02.762ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm
13082024-08-30T01:17:02.762ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13092024-08-30T01:17:02.763ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::guest_reboot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
13102024-08-30T01:17:02.763ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13112024-08-30T01:17:02.763ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13122024-08-30T01:17:09.696ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 6932 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13132024-08-30T01:17:09.696ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::guest_reboot_test step = WriteStr("root") target = phd_framework::test_vm
13142024-08-30T01:17:09.696ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::guest_reboot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
13152024-08-30T01:17:09.696ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13162024-08-30T01:17:09.696ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13172024-08-30T01:17:09.712ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 15 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13182024-08-30T01:17:09.712ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm
13192024-08-30T01:17:09.712ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 6949 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm
13202024-08-30T01:17:09.712ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13212024-08-30T01:17:09.713ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
13222024-08-30T01:17:09.713ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 11640 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
13232024-08-30T01:17:09.713ZINFOphd-runner: test phd_tests::crucible::smoke::guest_reboot_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
13242024-08-30T01:17:09.713ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
13252024-08-30T01:17:09.714ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13262024-08-30T01:17:10.164ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::smoke::guest_reboot_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13272024-08-30T01:17:10.299ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::guest_reboot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9000" } } target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13282024-08-30T01:17:10.310ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::guest_reboot_test self.path = "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9000" target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13292024-08-30T01:17:10.321ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::guest_reboot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9001" } } target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13302024-08-30T01:17:10.334ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::guest_reboot_test self.path = "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9001" target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13312024-08-30T01:17:10.344ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::guest_reboot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9002" } } target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13322024-08-30T01:17:10.356ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::guest_reboot_test self.path = "/tmp/propolis-phd/b5e57de4-4603-4f57-a5c7-d9ee5d060424_9002" target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13332024-08-30T01:17:10.366ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 653 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 9b997479-8b24-412a-b353-7f19ad364858
13342024-08-30T01:17:10.366ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 12967 file = phd-tests/tests/src/crucible/smoke.rs line = 31 path = phd_tests::crucible::smoke::guest_reboot_test target = phd_tests::crucible::smoke
13352024-08-30T01:17:10.367ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 653 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
13362024-08-30T01:17:10.367ZINFOphd-runner: Starting test phd_tests::crucible::smoke::api_reboot_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
13372024-08-30T01:17:10.367ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
13382024-08-30T01:17:10.367ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
13392024-08-30T01:17:10.367ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/smoke.rs line = 19 path = phd_tests::crucible::smoke::api_reboot_test target = phd_tests::crucible::smoke
13402024-08-30T01:17:10.367ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
13412024-08-30T01:17:10.367ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
13422024-08-30T01:17:10.367ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/381af7d19fb0edf80fb98eba86749602a8784ae79c5a04e0a27020df1a2ec079/crucible-downstairs target = phd_framework::artifacts::store
13432024-08-30T01:17:10.367ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
13442024-08-30T01:17:10.367ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9000", "--encrypted", "--uuid", "bd315644-e31d-4198-81da-775ce3fd5840", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13452024-08-30T01:17:10.430ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::api_reboot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.389681682Z","hostname":"buskin","pid":1027}\n{"msg":"UUID: bd315644-e31d-4198-81da-775ce3fd5840","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.422450827Z","hostname":"buskin","pid":1027}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.422466887Z","hostname":"buskin","pid":1027}\n target = phd_framework::disk::crucible
13462024-08-30T01:17:10.431ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9001", "--encrypted", "--uuid", "bd315644-e31d-4198-81da-775ce3fd5840", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13472024-08-30T01:17:10.490ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::api_reboot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.450818389Z","hostname":"buskin","pid":1028}\n{"msg":"UUID: bd315644-e31d-4198-81da-775ce3fd5840","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.482502434Z","hostname":"buskin","pid":1028}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.482517174Z","hostname":"buskin","pid":1028}\n target = phd_framework::disk::crucible
13482024-08-30T01:17:10.490ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9002", "--encrypted", "--uuid", "bd315644-e31d-4198-81da-775ce3fd5840", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13492024-08-30T01:17:10.547ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::api_reboot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.505595121Z","hostname":"buskin","pid":1029}\n{"msg":"UUID: bd315644-e31d-4198-81da-775ce3fd5840","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.53927267Z","hostname":"buskin","pid":1029}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:10.539281311Z","hostname":"buskin","pid":1029}\n target = phd_framework::disk::crucible
13502024-08-30T01:17:10.547ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::api_reboot_test stderr_path = "/tmp/propolis-phd/crucible_bd315644-e31d-4198-81da-775ce3fd5840_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_bd315644-e31d-4198-81da-775ce3fd5840_9000.stdout.log" target = phd_framework::server_log_mode
13512024-08-30T01:17:10.547ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13522024-08-30T01:17:10.547ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13532024-08-30T01:17:10.555ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::api_reboot_test stderr_path = "/tmp/propolis-phd/crucible_bd315644-e31d-4198-81da-775ce3fd5840_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_bd315644-e31d-4198-81da-775ce3fd5840_9001.stdout.log" target = phd_framework::server_log_mode
13542024-08-30T01:17:10.555ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13552024-08-30T01:17:10.555ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13562024-08-30T01:17:10.563ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::api_reboot_test stderr_path = "/tmp/propolis-phd/crucible_bd315644-e31d-4198-81da-775ce3fd5840_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_bd315644-e31d-4198-81da-775ce3fd5840_9002.stdout.log" target = phd_framework::server_log_mode
13572024-08-30T01:17:10.563ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13582024-08-30T01:17:10.563ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::disk::crucible
13592024-08-30T01:17:10.571ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm
13602024-08-30T01:17:10.571ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm_name = crucible_guest_reboot_test
13612024-08-30T01:17:10.571ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
13622024-08-30T01:17:10.571ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_guest_reboot_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::smoke::api_reboot_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
13632024-08-30T01:17:10.571ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::api_reboot_test stderr_path = "/tmp/propolis-phd/crucible_guest_reboot_test.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_guest_reboot_test.stdout.log" target = phd_framework::server_log_mode
13642024-08-30T01:17:10.579ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1033 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm::server
13652024-08-30T01:17:10.580ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm
13662024-08-30T01:17:10.580ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13672024-08-30T01:17:10.580ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13682024-08-30T01:17:11.272ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
13692024-08-30T01:17:11.273ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 676e2104-ad7b-4ede-bb26-08b338db0f02, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: e3c834fa-fb94-4a1f-8c9b-5a996387af19, silo_id: 0b449eb8-11c1-4c1d-9c2a-ca18dfd720f3, sled_id: 3112132d-3348-4e75-a314-be015df11f9f, sled_model: "pheidippes", sled_revision: 1, sled_serial: "3112132d-3348-4e75-a314-be015df11f9f" }, name: "phd-vm-676e2104-ad7b-4ede-bb26-08b338db0f02", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13702024-08-30T01:17:11.273ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 693 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13712024-08-30T01:17:11.273ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13722024-08-30T01:17:11.273ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::crucible::smoke::api_reboot_test state = Run target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13732024-08-30T01:17:11.274ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13742024-08-30T01:17:11.274ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm
13752024-08-30T01:17:11.274ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13762024-08-30T01:17:11.274ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::api_reboot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
13772024-08-30T01:17:11.274ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13782024-08-30T01:17:11.274ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13792024-08-30T01:17:15.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4665 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13802024-08-30T01:17:15.939ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::api_reboot_test step = WriteStr("root") target = phd_framework::test_vm
13812024-08-30T01:17:15.939ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::api_reboot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
13822024-08-30T01:17:15.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13832024-08-30T01:17:15.939ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13842024-08-30T01:17:15.955ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13852024-08-30T01:17:15.956ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm
13862024-08-30T01:17:15.956ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4681 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm
13872024-08-30T01:17:15.956ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13882024-08-30T01:17:15.956ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::crucible::smoke::api_reboot_test state = Reboot target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13892024-08-30T01:17:15.957ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13902024-08-30T01:17:15.957ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm
13912024-08-30T01:17:15.957ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13922024-08-30T01:17:15.957ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::api_reboot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
13932024-08-30T01:17:15.957ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13942024-08-30T01:17:15.957ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13952024-08-30T01:17:20.458ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4501 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13962024-08-30T01:17:20.459ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::api_reboot_test step = WriteStr("root") target = phd_framework::test_vm
13972024-08-30T01:17:20.459ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::api_reboot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
13982024-08-30T01:17:20.459ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
13992024-08-30T01:17:20.459ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14002024-08-30T01:17:20.476ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14012024-08-30T01:17:20.476ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm
14022024-08-30T01:17:20.476ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4519 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm
14032024-08-30T01:17:20.476ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14042024-08-30T01:17:20.476ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
14052024-08-30T01:17:20.476ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 9204 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
14062024-08-30T01:17:20.476ZINFOphd-runner: test phd_tests::crucible::smoke::api_reboot_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
14072024-08-30T01:17:20.476ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
14082024-08-30T01:17:20.477ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14092024-08-30T01:17:21.089ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::smoke::api_reboot_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14102024-08-30T01:17:21.220ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::api_reboot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9000" } } target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14112024-08-30T01:17:21.231ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::api_reboot_test self.path = "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9000" target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14122024-08-30T01:17:21.241ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::api_reboot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9001" } } target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14132024-08-30T01:17:21.254ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::api_reboot_test self.path = "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9001" target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14142024-08-30T01:17:21.264ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::api_reboot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9002" } } target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14152024-08-30T01:17:21.275ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::api_reboot_test self.path = "/tmp/propolis-phd/bd315644-e31d-4198-81da-775ce3fd5840_9002" target = phd_framework::disk::crucible vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14162024-08-30T01:17:21.286ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 809 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::smoke::api_reboot_test target = phd_framework::test_vm vm = crucible_guest_reboot_test vm_id = 676e2104-ad7b-4ede-bb26-08b338db0f02
14172024-08-30T01:17:21.286ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 10918 file = phd-tests/tests/src/crucible/smoke.rs line = 19 path = phd_tests::crucible::smoke::api_reboot_test target = phd_tests::crucible::smoke
14182024-08-30T01:17:21.286ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 809 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
14192024-08-30T01:17:21.286ZINFOphd-runner: Starting test phd_tests::crucible::smoke::boot_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
14202024-08-30T01:17:21.286ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
14212024-08-30T01:17:21.286ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
14222024-08-30T01:17:21.286ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/smoke.rs line = 10 path = phd_tests::crucible::smoke::boot_test target = phd_tests::crucible::smoke
14232024-08-30T01:17:21.287ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
14242024-08-30T01:17:21.287ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
14252024-08-30T01:17:21.287ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/381af7d19fb0edf80fb98eba86749602a8784ae79c5a04e0a27020df1a2ec079/crucible-downstairs target = phd_framework::artifacts::store
14262024-08-30T01:17:21.287ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
14272024-08-30T01:17:21.287ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9000", "--encrypted", "--uuid", "ebdbba25-d8cb-4c3a-a801-202a954306dd", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14282024-08-30T01:17:21.347ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::boot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.306282427Z","hostname":"buskin","pid":1035}\n{"msg":"UUID: ebdbba25-d8cb-4c3a-a801-202a954306dd","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.339187255Z","hostname":"buskin","pid":1035}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.339202776Z","hostname":"buskin","pid":1035}\n target = phd_framework::disk::crucible
14292024-08-30T01:17:21.347ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9001", "--encrypted", "--uuid", "ebdbba25-d8cb-4c3a-a801-202a954306dd", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14302024-08-30T01:17:21.409ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::boot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.367922988Z","hostname":"buskin","pid":1036}\n{"msg":"UUID: ebdbba25-d8cb-4c3a-a801-202a954306dd","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.401457163Z","hostname":"buskin","pid":1036}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.401477114Z","hostname":"buskin","pid":1036}\n target = phd_framework::disk::crucible
14312024-08-30T01:17:21.410ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9002", "--encrypted", "--uuid", "ebdbba25-d8cb-4c3a-a801-202a954306dd", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14322024-08-30T01:17:21.471ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::smoke::boot_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.429493957Z","hostname":"buskin","pid":1037}\n{"msg":"UUID: ebdbba25-d8cb-4c3a-a801-202a954306dd","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.462684783Z","hostname":"buskin","pid":1037}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:21.462699264Z","hostname":"buskin","pid":1037}\n target = phd_framework::disk::crucible
14332024-08-30T01:17:21.471ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::boot_test stderr_path = "/tmp/propolis-phd/crucible_ebdbba25-d8cb-4c3a-a801-202a954306dd_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_ebdbba25-d8cb-4c3a-a801-202a954306dd_9000.stdout.log" target = phd_framework::server_log_mode
14342024-08-30T01:17:21.471ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14352024-08-30T01:17:21.471ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14362024-08-30T01:17:21.479ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::boot_test stderr_path = "/tmp/propolis-phd/crucible_ebdbba25-d8cb-4c3a-a801-202a954306dd_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_ebdbba25-d8cb-4c3a-a801-202a954306dd_9001.stdout.log" target = phd_framework::server_log_mode
14372024-08-30T01:17:21.479ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14382024-08-30T01:17:21.479ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14392024-08-30T01:17:21.487ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::boot_test stderr_path = "/tmp/propolis-phd/crucible_ebdbba25-d8cb-4c3a-a801-202a954306dd_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_ebdbba25-d8cb-4c3a-a801-202a954306dd_9002.stdout.log" target = phd_framework::server_log_mode
14402024-08-30T01:17:21.487ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14412024-08-30T01:17:21.487ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::smoke::boot_test target = phd_framework::disk::crucible
14422024-08-30T01:17:21.495ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
14432024-08-30T01:17:21.495ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm_name = crucible_boot_test
14442024-08-30T01:17:21.495ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
14452024-08-30T01:17:21.495ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_boot_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::smoke::boot_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
14462024-08-30T01:17:21.495ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::smoke::boot_test stderr_path = "/tmp/propolis-phd/crucible_boot_test.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_boot_test.stdout.log" target = phd_framework::server_log_mode
14472024-08-30T01:17:21.503ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1041 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm::server
14482024-08-30T01:17:21.503ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
14492024-08-30T01:17:21.504ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14502024-08-30T01:17:21.504ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14512024-08-30T01:17:22.134ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
14522024-08-30T01:17:22.135ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 68c41ba5-ea1b-45b1-9147-fe5ed8c61353, silo_id: 81ec9586-1efe-4832-b742-6c4841beb1b2, sled_id: f1e79112-7eb5-424a-a044-4cb6dcfcf67d, sled_model: "pheidippes", sled_revision: 1, sled_serial: "f1e79112-7eb5-424a-a044-4cb6dcfcf67d" }, name: "phd-vm-5a42bea3-a278-4a85-ba9a-2cf9eefbbba1", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14532024-08-30T01:17:22.135ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 631 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14542024-08-30T01:17:22.135ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14552024-08-30T01:17:22.135ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::crucible::smoke::boot_test state = Run target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14562024-08-30T01:17:22.136ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14572024-08-30T01:17:22.136ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
14582024-08-30T01:17:22.136ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14592024-08-30T01:17:22.136ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::boot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
14602024-08-30T01:17:22.136ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14612024-08-30T01:17:22.136ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14622024-08-30T01:17:26.842ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4706 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14632024-08-30T01:17:26.843ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::boot_test step = WriteStr("root") target = phd_framework::test_vm
14642024-08-30T01:17:26.843ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::smoke::boot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
14652024-08-30T01:17:26.843ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14662024-08-30T01:17:26.843ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14672024-08-30T01:17:26.860ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14682024-08-30T01:17:26.860ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
14692024-08-30T01:17:26.860ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4723 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm
14702024-08-30T01:17:26.860ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14712024-08-30T01:17:26.861ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
14722024-08-30T01:17:26.861ZINFOphd-runner: test phd_tests::crucible::smoke::boot_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
14732024-08-30T01:17:26.861ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 4726 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
14742024-08-30T01:17:26.861ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
14752024-08-30T01:17:26.862ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14762024-08-30T01:17:27.526ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::smoke::boot_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14772024-08-30T01:17:27.663ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::boot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9000" } } target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14782024-08-30T01:17:27.674ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::boot_test self.path = "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9000" target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14792024-08-30T01:17:27.686ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::boot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9001" } } target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14802024-08-30T01:17:27.697ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::boot_test self.path = "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9001" target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14812024-08-30T01:17:27.708ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::smoke::boot_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9002" } } target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14822024-08-30T01:17:27.720ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::smoke::boot_test self.path = "/tmp/propolis-phd/ebdbba25-d8cb-4c3a-a801-202a954306dd_9002" target = phd_framework::disk::crucible vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14832024-08-30T01:17:27.731ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 870 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::smoke::boot_test target = phd_framework::test_vm vm = crucible_boot_test vm_id = 5a42bea3-a278-4a85-ba9a-2cf9eefbbba1
14842024-08-30T01:17:27.731ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 6444 file = phd-tests/tests/src/crucible/smoke.rs line = 10 path = phd_tests::crucible::smoke::boot_test target = phd_tests::crucible::smoke
14852024-08-30T01:17:27.732ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 870 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
14862024-08-30T01:17:27.732ZINFOphd-runner: Starting test phd_tests::crucible::migrate::load_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
14872024-08-30T01:17:27.732ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
14882024-08-30T01:17:27.732ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
14892024-08-30T01:17:27.732ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/migrate.rs line = 39 path = phd_tests::crucible::migrate::load_test target = phd_tests::crucible::migrate
14902024-08-30T01:17:27.732ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
14912024-08-30T01:17:27.733ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
14922024-08-30T01:17:27.733ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/381af7d19fb0edf80fb98eba86749602a8784ae79c5a04e0a27020df1a2ec079/crucible-downstairs target = phd_framework::artifacts::store
14932024-08-30T01:17:27.733ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
14942024-08-30T01:17:27.733ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9000", "--encrypted", "--uuid", "d7b2cbed-d1a3-4303-b072-e205919a8861", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
14952024-08-30T01:17:27.796ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::load_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.753236857Z","hostname":"buskin","pid":1043}\n{"msg":"UUID: d7b2cbed-d1a3-4303-b072-e205919a8861","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.787010699Z","hostname":"buskin","pid":1043}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.78703058Z","hostname":"buskin","pid":1043}\n target = phd_framework::disk::crucible
14962024-08-30T01:17:27.796ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9001", "--encrypted", "--uuid", "d7b2cbed-d1a3-4303-b072-e205919a8861", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
14972024-08-30T01:17:27.857ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::load_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.815538777Z","hostname":"buskin","pid":1044}\n{"msg":"UUID: d7b2cbed-d1a3-4303-b072-e205919a8861","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.848767383Z","hostname":"buskin","pid":1044}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.848781844Z","hostname":"buskin","pid":1044}\n target = phd_framework::disk::crucible
14982024-08-30T01:17:27.857ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9002", "--encrypted", "--uuid", "d7b2cbed-d1a3-4303-b072-e205919a8861", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
14992024-08-30T01:17:27.914ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::load_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.873495196Z","hostname":"buskin","pid":1045}\n{"msg":"UUID: d7b2cbed-d1a3-4303-b072-e205919a8861","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.905777077Z","hostname":"buskin","pid":1045}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:27.905787157Z","hostname":"buskin","pid":1045}\n target = phd_framework::disk::crucible
15002024-08-30T01:17:27.914ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_d7b2cbed-d1a3-4303-b072-e205919a8861_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_d7b2cbed-d1a3-4303-b072-e205919a8861_9000.stdout.log" target = phd_framework::server_log_mode
15012024-08-30T01:17:27.914ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
15022024-08-30T01:17:27.914ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
15032024-08-30T01:17:27.921ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_d7b2cbed-d1a3-4303-b072-e205919a8861_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_d7b2cbed-d1a3-4303-b072-e205919a8861_9001.stdout.log" target = phd_framework::server_log_mode
15042024-08-30T01:17:27.921ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
15052024-08-30T01:17:27.921ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
15062024-08-30T01:17:27.928ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_d7b2cbed-d1a3-4303-b072-e205919a8861_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_d7b2cbed-d1a3-4303-b072-e205919a8861_9002.stdout.log" target = phd_framework::server_log_mode
15072024-08-30T01:17:27.928ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
15082024-08-30T01:17:27.928ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::load_test target = phd_framework::disk::crucible
15092024-08-30T01:17:27.937ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
15102024-08-30T01:17:27.937ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm_name = crucible_load_test_source
15112024-08-30T01:17:27.937ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
15122024-08-30T01:17:27.937ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_load_test_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::migrate::load_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
15132024-08-30T01:17:27.937ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_load_test_source.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_load_test_source.stdout.log" target = phd_framework::server_log_mode
15142024-08-30T01:17:27.945ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1049 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm::server
15152024-08-30T01:17:27.945ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
15162024-08-30T01:17:27.945ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15172024-08-30T01:17:27.946ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15182024-08-30T01:17:28.778ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
15192024-08-30T01:17:28.779ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 11347259-6211-4b3b-b561-6a6270436f50, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: a77a7d9f-7654-4d92-b634-02721c4530f4, silo_id: 4f0d0d1d-cad4-4c96-b228-3bd88c7e8c84, sled_id: 32904ed8-63b1-44dd-8eb5-7012e3f7d6d6, sled_model: "pheidippes", sled_revision: 1, sled_serial: "32904ed8-63b1-44dd-8eb5-7012e3f7d6d6" }, name: "phd-vm-11347259-6211-4b3b-b561-6a6270436f50", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15202024-08-30T01:17:28.779ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 834 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15212024-08-30T01:17:28.780ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15222024-08-30T01:17:28.780ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::crucible::migrate::load_test state = Run target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15232024-08-30T01:17:28.780ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15242024-08-30T01:17:28.780ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
15252024-08-30T01:17:28.780ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15262024-08-30T01:17:28.780ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::migrate::load_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
15272024-08-30T01:17:28.780ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15282024-08-30T01:17:28.780ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15292024-08-30T01:17:33.465ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4684 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15302024-08-30T01:17:33.465ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::migrate::load_test step = WriteStr("root") target = phd_framework::test_vm
15312024-08-30T01:17:33.465ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::migrate::load_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
15322024-08-30T01:17:33.465ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15332024-08-30T01:17:33.465ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15342024-08-30T01:17:33.481ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 15 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15352024-08-30T01:17:33.481ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
15362024-08-30T01:17:33.481ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4700 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
15372024-08-30T01:17:33.481ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
15382024-08-30T01:17:33.482ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm_name = crucible_load_test_target
15392024-08-30T01:17:33.482ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
15402024-08-30T01:17:33.482ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_load_test_target.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::migrate::load_test server_addr = 127.0.0.1:9005 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
15412024-08-30T01:17:33.482ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::load_test stderr_path = "/tmp/propolis-phd/crucible_load_test_target.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_load_test_target.stdout.log" target = phd_framework::server_log_mode
15422024-08-30T01:17:33.494ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1050 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm::server
15432024-08-30T01:17:33.494ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 12 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm
15442024-08-30T01:17:33.494ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15452024-08-30T01:17:33.494ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15462024-08-30T01:17:33.503ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15472024-08-30T01:17:33.503ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15482024-08-30T01:17:33.503ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15492024-08-30T01:17:33.731ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 227 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15502024-08-30T01:17:33.731ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15512024-08-30T01:17:33.731ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15522024-08-30T01:17:33.741ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15532024-08-30T01:17:33.742ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15542024-08-30T01:17:33.742ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15552024-08-30T01:17:34.008ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 266 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15562024-08-30T01:17:34.008ZINFOphd-runner: [TEST - EVENT] Generated SHA256 checksum: 0e63e8c07dae3bc96effb0c9ed46287121b67e8105cbb2de68f519258caeef10 file = phd-tests/tests/src/crucible/migrate.rs line = 72 path = phd_tests::crucible::migrate::load_test target = phd_tests::crucible::migrate
15572024-08-30T01:17:34.008ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15582024-08-30T01:17:34.008ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15592024-08-30T01:17:34.020ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15602024-08-30T01:17:34.020ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15612024-08-30T01:17:34.020ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15622024-08-30T01:17:34.042ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15632024-08-30T01:17:34.042ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15642024-08-30T01:17:34.042ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9003 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = fc029cc5-2042-4936-a229-8cb561cf6e68 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68 timeout_duration = 45s
15652024-08-30T01:17:34.042ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68 vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15662024-08-30T01:17:34.162ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 51e4c128-dbdb-4334-bfcc-18b94c7cdb68, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: a77a7d9f-7654-4d92-b634-02721c4530f4, silo_id: 4f0d0d1d-cad4-4c96-b228-3bd88c7e8c84, sled_id: 505b6f87-d8c5-44ae-af58-d44ca533929e, sled_model: "pheidippes", sled_revision: 1, sled_serial: "505b6f87-d8c5-44ae-af58-d44ca533929e" }, name: "phd-vm-51e4c128-dbdb-4334-bfcc-18b94c7cdb68", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68 vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15672024-08-30T01:17:34.163ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 120 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68 vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15682024-08-30T01:17:34.163ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = fc029cc5-2042-4936-a229-8cb561cf6e68 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15692024-08-30T01:17:38.369ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9005","from_start":7920}} target = phd_framework::serial
15702024-08-30T01:17:40.835ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15712024-08-30T01:17:40.835ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 6672 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = fc029cc5-2042-4936-a229-8cb561cf6e68 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15722024-08-30T01:17:40.835ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 6793 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::crucible::migrate::load_test source = crucible_load_test_source source_id = 11347259-6211-4b3b-b561-6a6270436f50 target = phd_framework::test_vm target_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15732024-08-30T01:17:40.836ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15742024-08-30T01:17:40.836ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15752024-08-30T01:17:40.847ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15762024-08-30T01:17:40.848ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15772024-08-30T01:17:40.848ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15782024-08-30T01:17:40.881ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 33 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15792024-08-30T01:17:40.881ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15802024-08-30T01:17:40.881ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15812024-08-30T01:17:40.892ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15822024-08-30T01:17:40.892ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15832024-08-30T01:17:40.892ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15842024-08-30T01:17:41.161ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 269 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15852024-08-30T01:17:41.161ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15862024-08-30T01:17:41.161ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15872024-08-30T01:17:41.162ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
15882024-08-30T01:17:41.162ZINFOphd-runner: test phd_tests::crucible::migrate::load_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
15892024-08-30T01:17:41.162ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
15902024-08-30T01:17:41.162ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 12383 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
15912024-08-30T01:17:41.162ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15922024-08-30T01:17:41.163ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::migrate::load_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15932024-08-30T01:17:41.297ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 135 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_source vm_id = 11347259-6211-4b3b-b561-6a6270436f50
15942024-08-30T01:17:41.298ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::migrate::load_test self.address = 127.0.0.1:9005 target = phd_framework::test_vm::server vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15952024-08-30T01:17:41.442ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::load_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9000" } } target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15962024-08-30T01:17:41.453ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::load_test self.path = "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9000" target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15972024-08-30T01:17:41.464ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::load_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9001" } } target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15982024-08-30T01:17:41.477ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::load_test self.path = "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9001" target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
15992024-08-30T01:17:41.488ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::load_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9002" } } target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
16002024-08-30T01:17:41.500ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::load_test self.path = "/tmp/propolis-phd/d7b2cbed-d1a3-4303-b072-e205919a8861_9002" target = phd_framework::disk::crucible vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
16012024-08-30T01:17:41.511ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 349 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::migrate::load_test target = phd_framework::test_vm vm = crucible_load_test_target vm_id = 51e4c128-dbdb-4334-bfcc-18b94c7cdb68
16022024-08-30T01:17:41.511ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 13778 file = phd-tests/tests/src/crucible/migrate.rs line = 39 path = phd_tests::crucible::migrate::load_test target = phd_tests::crucible::migrate
16032024-08-30T01:17:41.511ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 349 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
16042024-08-30T01:17:41.511ZINFOphd-runner: Starting test phd_tests::crucible::migrate::smoke_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
16052024-08-30T01:17:41.511ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
16062024-08-30T01:17:41.511ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
16072024-08-30T01:17:41.511ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/crucible/migrate.rs line = 10 path = phd_tests::crucible::migrate::smoke_test target = phd_tests::crucible::migrate
16082024-08-30T01:17:41.512ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
16092024-08-30T01:17:41.512ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
16102024-08-30T01:17:41.512ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/381af7d19fb0edf80fb98eba86749602a8784ae79c5a04e0a27020df1a2ec079/crucible-downstairs target = phd_framework::artifacts::store
16112024-08-30T01:17:41.512ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
16122024-08-30T01:17:41.512ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9000", "--encrypted", "--uuid", "05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16132024-08-30T01:17:41.576ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::smoke_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9000/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.532781287Z","hostname":"buskin","pid":1053}\n{"msg":"UUID: 05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.567511066Z","hostname":"buskin","pid":1053}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.567527426Z","hostname":"buskin","pid":1053}\n target = phd_framework::disk::crucible
16142024-08-30T01:17:41.577ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9001", "--encrypted", "--uuid", "05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16152024-08-30T01:17:41.635ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::smoke_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9001/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.592087634Z","hostname":"buskin","pid":1054}\n{"msg":"UUID: 05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.626216426Z","hostname":"buskin","pid":1054}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.626226656Z","hostname":"buskin","pid":1054}\n target = phd_framework::disk::crucible
16162024-08-30T01:17:41.635ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["create", "--block-size", "512", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9002", "--encrypted", "--uuid", "05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e", "--extent-size", "131072", "--extent-count", "160"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16172024-08-30T01:17:41.690ZINFOphd-runner: [TEST - EVENT] Created Crucible region using crucible-downstairs file = phd-tests/framework/src/disk/crucible.rs line = 202 path = phd_tests::crucible::migrate::smoke_test status = ExitStatus(unix_wait_status(0)) stderr = stdout = {"msg":"Created new region file \\"/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9002/region.json\\"","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.649627082Z","hostname":"buskin","pid":1055}\n{"msg":"UUID: 05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.682310714Z","hostname":"buskin","pid":1055}\n{"msg":"Blocks per extent:131072 Total Extents: 160","v":0,"name":"crucible","level":30,"time":"2024-08-30T01:17:41.682320454Z","hostname":"buskin","pid":1055}\n target = phd_framework::disk::crucible
16182024-08-30T01:17:41.690ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9000.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9000.stdout.log" target = phd_framework::server_log_mode
16192024-08-30T01:17:41.690ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16202024-08-30T01:17:41.691ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9000", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9000"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16212024-08-30T01:17:41.698ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9001.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9001.stdout.log" target = phd_framework::server_log_mode
16222024-08-30T01:17:41.698ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16232024-08-30T01:17:41.698ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9001", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9001"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16242024-08-30T01:17:41.706ZINFOphd-runner: [TEST - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9002.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9002.stdout.log" target = phd_framework::server_log_mode
16252024-08-30T01:17:41.706ZINFOphd-runner: [TEST - EVENT] Launching Crucible downstairs server crucible_args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 238 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16262024-08-30T01:17:41.706ZINFOphd-runner: [TEST - EVENT] Running crucible-downstairs args = ["run", "--address", "127.0.0.1", "--port", "9002", "--data", "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9002"] file = phd-tests/framework/src/disk/crucible.rs line = 346 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::disk::crucible
16272024-08-30T01:17:41.714ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
16282024-08-30T01:17:41.714ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm_name = crucible_migrate_smoke_source
16292024-08-30T01:17:41.714ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
16302024-08-30T01:17:41.714ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_migrate_smoke_source.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::migrate::smoke_test server_addr = 127.0.0.1:9003 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
16312024-08-30T01:17:41.714ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_migrate_smoke_source.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_migrate_smoke_source.stdout.log" target = phd_framework::server_log_mode
16322024-08-30T01:17:41.721ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1059 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm::server
16332024-08-30T01:17:41.722ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 7 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
16342024-08-30T01:17:41.722ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16352024-08-30T01:17:41.722ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16362024-08-30T01:17:42.319ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
16372024-08-30T01:17:42.320ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: f216232e-6a55-4917-97f2-03031cdef3af, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 37e48101-941f-4b92-af89-17cc64048135, silo_id: 33828bc7-8d23-4bc0-8232-e1b9a3bc615c, sled_id: a5fe3e9b-78e8-4dda-b270-ff4c8454782a, sled_model: "pheidippes", sled_revision: 1, sled_serial: "a5fe3e9b-78e8-4dda-b270-ff4c8454782a" }, name: "phd-vm-f216232e-6a55-4917-97f2-03031cdef3af", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16382024-08-30T01:17:42.320ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 597 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16392024-08-30T01:17:42.320ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16402024-08-30T01:17:42.320ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::crucible::migrate::smoke_test state = Run target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16412024-08-30T01:17:42.320ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16422024-08-30T01:17:42.321ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
16432024-08-30T01:17:42.321ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = 300s vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16442024-08-30T01:17:42.321ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::migrate::smoke_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
16452024-08-30T01:17:42.321ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16462024-08-30T01:17:42.321ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16472024-08-30T01:17:46.977ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4656 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16482024-08-30T01:17:46.977ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::migrate::smoke_test step = WriteStr("root") target = phd_framework::test_vm
16492024-08-30T01:17:46.977ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::crucible::migrate::smoke_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
16502024-08-30T01:17:46.977ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16512024-08-30T01:17:46.977ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16522024-08-30T01:17:46.993ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 15 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16532024-08-30T01:17:46.993ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
16542024-08-30T01:17:46.993ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4672 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
16552024-08-30T01:17:46.994ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16562024-08-30T01:17:46.994ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16572024-08-30T01:17:47.004ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16582024-08-30T01:17:47.004ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16592024-08-30T01:17:47.004ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16602024-08-30T01:17:47.026ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16612024-08-30T01:17:47.026ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16622024-08-30T01:17:47.026ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16632024-08-30T01:17:47.038ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16642024-08-30T01:17:47.038ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16652024-08-30T01:17:47.038ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16662024-08-30T01:17:47.070ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16672024-08-30T01:17:47.070ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16682024-08-30T01:17:47.070ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16692024-08-30T01:17:47.081ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16702024-08-30T01:17:47.081ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16712024-08-30T01:17:47.081ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16722024-08-30T01:17:47.103ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 21 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16732024-08-30T01:17:47.103ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
16742024-08-30T01:17:47.103ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm_name = crucible_migrate_smoke_target
16752024-08-30T01:17:47.103ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
16762024-08-30T01:17:47.103ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/crucible_migrate_smoke_target.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::crucible::migrate::smoke_test server_addr = 127.0.0.1:9005 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
16772024-08-30T01:17:47.103ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::crucible::migrate::smoke_test stderr_path = "/tmp/propolis-phd/crucible_migrate_smoke_target.stderr.log" stdout_path = "/tmp/propolis-phd/crucible_migrate_smoke_target.stdout.log" target = phd_framework::server_log_mode
16782024-08-30T01:17:47.116ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1060 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm::server
16792024-08-30T01:17:47.116ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 13 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm
16802024-08-30T01:17:47.116ZINFOphd-runner: [MIGRATE_FROM - START] file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16812024-08-30T01:17:47.116ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9003 file = phd-tests/framework/src/test_vm/mod.rs line = 509 migration_id = edd7022e-3e44-431b-b037-98f5b6b40d25 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750 timeout_duration = 45s
16822024-08-30T01:17:47.116ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750 vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16832024-08-30T01:17:47.117ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9005/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750 vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16842024-08-30T01:17:47.978ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 92ec06e4-e367-499c-b450-e2f4a7455750, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 37e48101-941f-4b92-af89-17cc64048135, silo_id: 33828bc7-8d23-4bc0-8232-e1b9a3bc615c, sled_id: 73fdecc6-0a16-43a5-a81d-ec803b9100ff, sled_model: "pheidippes", sled_revision: 1, sled_serial: "73fdecc6-0a16-43a5-a81d-ec803b9100ff" }, name: "phd-vm-92ec06e4-e367-499c-b450-e2f4a7455750", vcpus: 2 }, state: Migrating } line = 387 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750 vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16852024-08-30T01:17:47.978ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 861 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750 vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16862024-08-30T01:17:47.978ZINFOphd-runner: [MIGRATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = edd7022e-3e44-431b-b037-98f5b6b40d25 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16872024-08-30T01:17:50.673ZINFOphd-runner: [SERIAL CONSOLE TASK - EVENT] serial socket control message file = phd-tests/framework/src/serial/mod.rs line = 275 s = {"Migrating":{"destination":"127.0.0.1:9005","from_start":7718}} target = phd_framework::serial
16882024-08-30T01:17:51.671ZINFOphd-runner: [MIGRATE_FROM - EVENT] Migration completed successfully file = phd-tests/framework/src/test_vm/mod.rs line = 542 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16892024-08-30T01:17:51.671ZINFOphd-runner: [MIGRATE - END] elapsed_milliseconds = 3692 file = phd-tests/framework/src/test_vm/mod.rs line = 529 migration_id = edd7022e-3e44-431b-b037-98f5b6b40d25 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16902024-08-30T01:17:51.671ZINFOphd-runner: [MIGRATE_FROM - END] elapsed_milliseconds = 4554 file = phd-tests/framework/src/test_vm/mod.rs line = 476 path = phd_tests::crucible::migrate::smoke_test source = crucible_migrate_smoke_source source_id = f216232e-6a55-4917-97f2-03031cdef3af target = phd_framework::test_vm target_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16912024-08-30T01:17:51.671ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16922024-08-30T01:17:51.671ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16932024-08-30T01:17:51.683ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 11 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16942024-08-30T01:17:51.683ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16952024-08-30T01:17:51.683ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16962024-08-30T01:17:51.715ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16972024-08-30T01:17:51.716ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
16982024-08-30T01:17:51.716ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
16992024-08-30T01:17:51.716ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
17002024-08-30T01:17:51.716ZINFOphd-runner: test phd_tests::crucible::migrate::smoke_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
17012024-08-30T01:17:51.716ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 9397 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
17022024-08-30T01:17:51.716ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
17032024-08-30T01:17:51.717ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17042024-08-30T01:17:51.718ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::migrate::smoke_test self.address = 127.0.0.1:9003 target = phd_framework::test_vm::server vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
17052024-08-30T01:17:51.854ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 137 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_source vm_id = f216232e-6a55-4917-97f2-03031cdef3af
17062024-08-30T01:17:51.855ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::crucible::migrate::smoke_test self.address = 127.0.0.1:9005 target = phd_framework::test_vm::server vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17072024-08-30T01:17:52.001ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::smoke_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9000" } } target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17082024-08-30T01:17:52.015ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::smoke_test self.path = "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9000" target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17092024-08-30T01:17:52.026ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::smoke_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9001" } } target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17102024-08-30T01:17:52.039ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::smoke_test self.path = "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9001" target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17112024-08-30T01:17:52.049ZINFOphd-runner: [VM CLEANUP - EVENT] Stopping Crucible downstairs process file = phd-tests/framework/src/disk/crucible.rs line = 54 path = phd_tests::crucible::migrate::smoke_test self = Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9002" } } target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17122024-08-30T01:17:52.060ZINFOphd-runner: [VM CLEANUP - EVENT] Deleting Crucible downstairs data directory file = phd-tests/framework/src/disk/crucible.rs line = 35 path = phd_tests::crucible::migrate::smoke_test self.path = "/tmp/propolis-phd/05ae6d67-ebe9-4cb9-acba-81a4d7b36c0e_9002" target = phd_framework::disk::crucible vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17132024-08-30T01:17:52.070ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 354 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::crucible::migrate::smoke_test target = phd_framework::test_vm vm = crucible_migrate_smoke_target vm_id = 92ec06e4-e367-499c-b450-e2f4a7455750
17142024-08-30T01:17:52.070ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 10558 file = phd-tests/tests/src/crucible/migrate.rs line = 10 path = phd_tests::crucible::migrate::smoke_test target = phd_tests::crucible::migrate
17152024-08-30T01:17:52.071ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 354 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
17162024-08-30T01:17:52.071ZINFOphd-runner: Starting test phd_tests::smoke::instance_spec_get_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
17172024-08-30T01:17:52.071ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
17182024-08-30T01:17:52.071ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
17192024-08-30T01:17:52.071ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/smoke.rs line = 39 path = phd_tests::smoke::instance_spec_get_test target = phd_tests::smoke
17202024-08-30T01:17:52.071ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
17212024-08-30T01:17:52.071ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
17222024-08-30T01:17:52.071ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
17232024-08-30T01:17:52.071ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = list
17242024-08-30T01:17:52.089ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::instance_spec_get_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 171M 1.80T 169M /phd-artifacts\n target = phd_framework::zfs
17252024-08-30T01:17:52.089ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-e3f5de8a-65b1-4075-aa07-0d0f68e0e0b4"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = snapshot
17262024-08-30T01:17:52.111ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-e3f5de8a-65b1-4075-aa07-0d0f68e0e0b4", "phd-artifacts/phd-clone-459e417a-5d87-4bd1-aebd-423d4e098a7f"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = clone
17272024-08-30T01:17:52.134ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-459e417a-5d87-4bd1-aebd-423d4e098a7f"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = list
17282024-08-30T01:17:52.148ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::instance_spec_get_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-459e417a-5d87-4bd1-aebd-423d4e098a7f 0B 1.80T 169M /phd-artifacts/phd-clone-459e417a-5d87-4bd1-aebd-423d4e098a7f\n target = phd_framework::zfs
17292024-08-30T01:17:52.148ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm
17302024-08-30T01:17:52.148ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm_name = instance_spec_test
17312024-08-30T01:17:52.148ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
17322024-08-30T01:17:52.149ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_spec_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::smoke::instance_spec_get_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
17332024-08-30T01:17:52.149ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::smoke::instance_spec_get_test stderr_path = "/tmp/propolis-phd/instance_spec_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_spec_test.stdout.log" target = phd_framework::server_log_mode
17342024-08-30T01:17:52.156ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1067 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm::server
17352024-08-30T01:17:52.156ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 7 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm
17362024-08-30T01:17:52.156ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17372024-08-30T01:17:52.157ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17382024-08-30T01:17:53.088ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
17392024-08-30T01:17:53.089ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd, image_id: 00000000-0000-0000-0000-000000000000, memory: 3072, metadata: InstanceMetadata { project_id: ed233dd9-6fd7-45de-9d93-9aef0ca6c13d, silo_id: 0ad14865-56b0-4462-ba1a-139f4e673ce7, sled_id: f2a063b3-13b6-4b56-aeb8-066bd8726013, sled_model: "pheidippes", sled_revision: 1, sled_serial: "f2a063b3-13b6-4b56-aeb8-066bd8726013" }, name: "phd-vm-c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd", vcpus: 4 }, state: Creating } line = 387 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17402024-08-30T01:17:53.089ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 932 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17412024-08-30T01:17:53.089ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17422024-08-30T01:17:53.089ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::smoke::instance_spec_get_test state = Run target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17432024-08-30T01:17:53.090ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17442024-08-30T01:17:53.090ZINFOphd-runner: [GET_SPEC - START] file = phd-tests/framework/src/test_vm/mod.rs line = 463 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17452024-08-30T01:17:53.090ZINFOphd-runner: [GET_SPEC - EVENT] Sending instance spec get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 465 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17462024-08-30T01:17:53.091ZINFOphd-runner: [GET_SPEC - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 463 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17472024-08-30T01:17:53.091ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17482024-08-30T01:17:53.092ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
17492024-08-30T01:17:53.092ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 3 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
17502024-08-30T01:17:53.092ZINFOphd-runner: test phd_tests::smoke::instance_spec_get_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
17512024-08-30T01:17:53.092ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
17522024-08-30T01:17:53.092ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17532024-08-30T01:17:53.446ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::smoke::instance_spec_get_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17542024-08-30T01:17:54.005ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17552024-08-30T01:17:54.005ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-459e417a-5d87-4bd1-aebd-423d4e098a7f"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = destroy vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17562024-08-30T01:17:54.045ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17572024-08-30T01:17:54.045ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-e3f5de8a-65b1-4075-aa07-0d0f68e0e0b4"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::zfs verb = destroy vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17582024-08-30T01:17:54.065ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 973 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::smoke::instance_spec_get_test target = phd_framework::test_vm vm = instance_spec_test vm_id = c35f90c8-8f8a-4d81-96f7-5cb1a6975bcd
17592024-08-30T01:17:54.065ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 1994 file = phd-tests/tests/src/smoke.rs line = 39 path = phd_tests::smoke::instance_spec_get_test target = phd_tests::smoke
17602024-08-30T01:17:54.066ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 973 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
17612024-08-30T01:17:54.066ZINFOphd-runner: Starting test phd_tests::smoke::guest_reboot_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
17622024-08-30T01:17:54.066ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
17632024-08-30T01:17:54.066ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
17642024-08-30T01:17:54.066ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/smoke.rs line = 27 path = phd_tests::smoke::guest_reboot_test target = phd_tests::smoke
17652024-08-30T01:17:54.066ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
17662024-08-30T01:17:54.066ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
17672024-08-30T01:17:54.066ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
17682024-08-30T01:17:54.066ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::guest_reboot_test target = phd_framework::zfs verb = list
17692024-08-30T01:17:54.080ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::guest_reboot_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 171M 1.80T 169M /phd-artifacts\n target = phd_framework::zfs
17702024-08-30T01:17:54.080ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-c193b980-ddb3-474d-8c6d-20edd428c894"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::guest_reboot_test target = phd_framework::zfs verb = snapshot
17712024-08-30T01:17:54.097ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-c193b980-ddb3-474d-8c6d-20edd428c894", "phd-artifacts/phd-clone-2ee1349a-3fac-434f-af73-94a7df4c8aaf"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::guest_reboot_test target = phd_framework::zfs verb = clone
17722024-08-30T01:17:54.115ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-2ee1349a-3fac-434f-af73-94a7df4c8aaf"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::guest_reboot_test target = phd_framework::zfs verb = list
17732024-08-30T01:17:54.127ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::guest_reboot_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-2ee1349a-3fac-434f-af73-94a7df4c8aaf 0B 1.80T 169M /phd-artifacts/phd-clone-2ee1349a-3fac-434f-af73-94a7df4c8aaf\n target = phd_framework::zfs
17742024-08-30T01:17:54.127ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm
17752024-08-30T01:17:54.127ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm_name = guest_reboot_test
17762024-08-30T01:17:54.127ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
17772024-08-30T01:17:54.128ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/guest_reboot_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::smoke::guest_reboot_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
17782024-08-30T01:17:54.128ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::smoke::guest_reboot_test stderr_path = "/tmp/propolis-phd/guest_reboot_test.stderr.log" stdout_path = "/tmp/propolis-phd/guest_reboot_test.stdout.log" target = phd_framework::server_log_mode
17792024-08-30T01:17:54.134ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1075 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm::server
17802024-08-30T01:17:54.134ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 6 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm
17812024-08-30T01:17:54.134ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17822024-08-30T01:17:54.134ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17832024-08-30T01:17:54.985ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
17842024-08-30T01:17:54.986ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 13ff8c71-ace8-4f1b-8cff-97e48b94803e, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 25d31e9e-1105-4e99-b32b-b5bc46a741c3, silo_id: 7328bbc7-4a35-4632-b37b-fd7b837409d4, sled_id: 8791713b-bb91-4990-ba18-abcc5bda27c6, sled_model: "pheidippes", sled_revision: 1, sled_serial: "8791713b-bb91-4990-ba18-abcc5bda27c6" }, name: "phd-vm-13ff8c71-ace8-4f1b-8cff-97e48b94803e", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17852024-08-30T01:17:54.986ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 852 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17862024-08-30T01:17:54.986ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17872024-08-30T01:17:54.986ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::smoke::guest_reboot_test state = Run target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17882024-08-30T01:17:54.987ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17892024-08-30T01:17:54.987ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm
17902024-08-30T01:17:54.987ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = 300s vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17912024-08-30T01:17:54.987ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::guest_reboot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
17922024-08-30T01:17:54.987ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17932024-08-30T01:17:54.987ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17942024-08-30T01:17:59.221ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4233 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17952024-08-30T01:17:59.221ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::guest_reboot_test step = WriteStr("root") target = phd_framework::test_vm
17962024-08-30T01:17:59.221ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::guest_reboot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
17972024-08-30T01:17:59.221ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17982024-08-30T01:17:59.222ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
17992024-08-30T01:17:59.238ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18002024-08-30T01:17:59.239ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm
18012024-08-30T01:17:59.239ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4251 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm
18022024-08-30T01:17:59.239ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm
18032024-08-30T01:17:59.239ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = 300s vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18042024-08-30T01:17:59.239ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::guest_reboot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
18052024-08-30T01:17:59.239ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18062024-08-30T01:17:59.239ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18072024-08-30T01:18:05.773ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 6533 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18082024-08-30T01:18:05.773ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::guest_reboot_test step = WriteStr("root") target = phd_framework::test_vm
18092024-08-30T01:18:05.773ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::guest_reboot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
18102024-08-30T01:18:05.773ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18112024-08-30T01:18:05.773ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18122024-08-30T01:18:05.789ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18132024-08-30T01:18:05.789ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm
18142024-08-30T01:18:05.789ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 6550 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm
18152024-08-30T01:18:05.790ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18162024-08-30T01:18:05.790ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
18172024-08-30T01:18:05.790ZINFOphd-runner: test phd_tests::smoke::guest_reboot_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
18182024-08-30T01:18:05.790ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 10804 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
18192024-08-30T01:18:05.790ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
18202024-08-30T01:18:05.791ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18212024-08-30T01:18:06.239ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::smoke::guest_reboot_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18222024-08-30T01:18:06.378ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::smoke::guest_reboot_test target = phd_framework::zfs vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18232024-08-30T01:18:06.378ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-2ee1349a-3fac-434f-af73-94a7df4c8aaf"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::guest_reboot_test target = phd_framework::zfs verb = destroy vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18242024-08-30T01:18:06.408ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::smoke::guest_reboot_test target = phd_framework::zfs vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18252024-08-30T01:18:06.408ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-c193b980-ddb3-474d-8c6d-20edd428c894"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::guest_reboot_test target = phd_framework::zfs verb = destroy vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18262024-08-30T01:18:06.430ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 640 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::smoke::guest_reboot_test target = phd_framework::test_vm vm = guest_reboot_test vm_id = 13ff8c71-ace8-4f1b-8cff-97e48b94803e
18272024-08-30T01:18:06.430ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 12364 file = phd-tests/tests/src/smoke.rs line = 27 path = phd_tests::smoke::guest_reboot_test target = phd_tests::smoke
18282024-08-30T01:18:06.430ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 640 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
18292024-08-30T01:18:06.430ZINFOphd-runner: Starting test phd_tests::smoke::api_reboot_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
18302024-08-30T01:18:06.431ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
18312024-08-30T01:18:06.431ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
18322024-08-30T01:18:06.431ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/smoke.rs line = 18 path = phd_tests::smoke::api_reboot_test target = phd_tests::smoke
18332024-08-30T01:18:06.431ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
18342024-08-30T01:18:06.431ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
18352024-08-30T01:18:06.431ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
18362024-08-30T01:18:06.431ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::api_reboot_test target = phd_framework::zfs verb = list
18372024-08-30T01:18:06.444ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::api_reboot_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 171M 1.80T 169M /phd-artifacts\n target = phd_framework::zfs
18382024-08-30T01:18:06.444ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-46192d63-7d71-4694-aa58-4cc5ffb70566"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::api_reboot_test target = phd_framework::zfs verb = snapshot
18392024-08-30T01:18:06.462ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-46192d63-7d71-4694-aa58-4cc5ffb70566", "phd-artifacts/phd-clone-2c923c09-5540-40bb-bf5e-23ed16a4cd34"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::api_reboot_test target = phd_framework::zfs verb = clone
18402024-08-30T01:18:06.480ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-2c923c09-5540-40bb-bf5e-23ed16a4cd34"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::api_reboot_test target = phd_framework::zfs verb = list
18412024-08-30T01:18:06.494ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::api_reboot_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-2c923c09-5540-40bb-bf5e-23ed16a4cd34 0B 1.80T 169M /phd-artifacts/phd-clone-2c923c09-5540-40bb-bf5e-23ed16a4cd34\n target = phd_framework::zfs
18422024-08-30T01:18:06.494ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm
18432024-08-30T01:18:06.494ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm_name = api_reboot_test
18442024-08-30T01:18:06.494ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
18452024-08-30T01:18:06.494ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/api_reboot_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::smoke::api_reboot_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
18462024-08-30T01:18:06.494ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::smoke::api_reboot_test stderr_path = "/tmp/propolis-phd/api_reboot_test.stderr.log" stdout_path = "/tmp/propolis-phd/api_reboot_test.stdout.log" target = phd_framework::server_log_mode
18472024-08-30T01:18:06.502ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1083 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm::server
18482024-08-30T01:18:06.503ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm
18492024-08-30T01:18:06.503ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18502024-08-30T01:18:06.503ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18512024-08-30T01:18:06.974ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
18522024-08-30T01:18:06.975ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 8d60f3e2-e022-4d19-9d55-88815dddce2f, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: c100ce17-1e9a-4f14-8b6d-a444d02d8692, silo_id: f759cdbe-7249-4e92-b3ba-7ff9709ee5b8, sled_id: d439b346-7621-4965-91c6-74e17041fcb4, sled_model: "pheidippes", sled_revision: 1, sled_serial: "d439b346-7621-4965-91c6-74e17041fcb4" }, name: "phd-vm-8d60f3e2-e022-4d19-9d55-88815dddce2f", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18532024-08-30T01:18:06.975ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 471 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18542024-08-30T01:18:06.975ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18552024-08-30T01:18:06.975ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::smoke::api_reboot_test state = Run target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18562024-08-30T01:18:06.975ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18572024-08-30T01:18:06.975ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm
18582024-08-30T01:18:06.975ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = 300s vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18592024-08-30T01:18:06.976ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::api_reboot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
18602024-08-30T01:18:06.976ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18612024-08-30T01:18:06.976ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18622024-08-30T01:18:11.185ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4209 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18632024-08-30T01:18:11.186ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::api_reboot_test step = WriteStr("root") target = phd_framework::test_vm
18642024-08-30T01:18:11.186ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::api_reboot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
18652024-08-30T01:18:11.186ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18662024-08-30T01:18:11.186ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18672024-08-30T01:18:11.203ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 17 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18682024-08-30T01:18:11.203ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm
18692024-08-30T01:18:11.203ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4227 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm
18702024-08-30T01:18:11.203ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18712024-08-30T01:18:11.203ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::smoke::api_reboot_test state = Reboot target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18722024-08-30T01:18:11.204ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18732024-08-30T01:18:11.204ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm
18742024-08-30T01:18:11.204ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = 300s vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18752024-08-30T01:18:11.204ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::api_reboot_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
18762024-08-30T01:18:11.204ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18772024-08-30T01:18:11.204ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18782024-08-30T01:18:15.331ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4126 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18792024-08-30T01:18:15.331ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::api_reboot_test step = WriteStr("root") target = phd_framework::test_vm
18802024-08-30T01:18:15.331ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::api_reboot_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
18812024-08-30T01:18:15.331ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18822024-08-30T01:18:15.332ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18832024-08-30T01:18:15.348ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 16 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18842024-08-30T01:18:15.349ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm
18852024-08-30T01:18:15.349ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4144 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm
18862024-08-30T01:18:15.349ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18872024-08-30T01:18:15.349ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
18882024-08-30T01:18:15.349ZINFOphd-runner: test phd_tests::smoke::api_reboot_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
18892024-08-30T01:18:15.349ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 8375 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
18902024-08-30T01:18:15.349ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
18912024-08-30T01:18:15.350ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18922024-08-30T01:18:15.705ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::smoke::api_reboot_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18932024-08-30T01:18:15.846ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::smoke::api_reboot_test target = phd_framework::zfs vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18942024-08-30T01:18:15.846ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-2c923c09-5540-40bb-bf5e-23ed16a4cd34"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::api_reboot_test target = phd_framework::zfs verb = destroy vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18952024-08-30T01:18:15.875ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::smoke::api_reboot_test target = phd_framework::zfs vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18962024-08-30T01:18:15.875ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-46192d63-7d71-4694-aa58-4cc5ffb70566"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::api_reboot_test target = phd_framework::zfs verb = destroy vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18972024-08-30T01:18:15.894ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 544 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::smoke::api_reboot_test target = phd_framework::test_vm vm = api_reboot_test vm_id = 8d60f3e2-e022-4d19-9d55-88815dddce2f
18982024-08-30T01:18:15.894ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 9463 file = phd-tests/tests/src/smoke.rs line = 18 path = phd_tests::smoke::api_reboot_test target = phd_tests::smoke
18992024-08-30T01:18:15.894ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 544 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
19002024-08-30T01:18:15.894ZINFOphd-runner: Starting test phd_tests::smoke::nproc_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
19012024-08-30T01:18:15.894ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
19022024-08-30T01:18:15.894ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
19032024-08-30T01:18:15.894ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/smoke.rs line = 7 path = phd_tests::smoke::nproc_test target = phd_tests::smoke
19042024-08-30T01:18:15.894ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
19052024-08-30T01:18:15.895ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
19062024-08-30T01:18:15.895ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
19072024-08-30T01:18:15.895ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = list
19082024-08-30T01:18:15.908ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::nproc_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 170M 1.80T 169M /phd-artifacts\n target = phd_framework::zfs
19092024-08-30T01:18:15.908ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-f48c5b78-60a6-41df-a5e8-909723431b81"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = snapshot
19102024-08-30T01:18:15.925ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-f48c5b78-60a6-41df-a5e8-909723431b81", "phd-artifacts/phd-clone-69841eeb-5d71-4d5b-8883-28b788fd3bbb"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = clone
19112024-08-30T01:18:15.943ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-69841eeb-5d71-4d5b-8883-28b788fd3bbb"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = list
19122024-08-30T01:18:15.956ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::smoke::nproc_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-69841eeb-5d71-4d5b-8883-28b788fd3bbb 0B 1.80T 169M /phd-artifacts/phd-clone-69841eeb-5d71-4d5b-8883-28b788fd3bbb\n target = phd_framework::zfs
19132024-08-30T01:18:15.957ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
19142024-08-30T01:18:15.957ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm_name = nproc_test
19152024-08-30T01:18:15.957ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
19162024-08-30T01:18:15.957ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/nproc_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::smoke::nproc_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
19172024-08-30T01:18:15.957ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::smoke::nproc_test stderr_path = "/tmp/propolis-phd/nproc_test.stderr.log" stdout_path = "/tmp/propolis-phd/nproc_test.stdout.log" target = phd_framework::server_log_mode
19182024-08-30T01:18:15.964ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1091 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm::server
19192024-08-30T01:18:15.965ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
19202024-08-30T01:18:15.965ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19212024-08-30T01:18:15.966ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19222024-08-30T01:18:16.547ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
19232024-08-30T01:18:16.548ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 1f862108-4f82-414c-8998-d25fcf8b1a4a, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 6759226c-b64e-48e3-bc1b-adf10af0875e, silo_id: 80c8a0b7-efe8-4bbe-9f18-0c8c74008173, sled_id: 9bc396cd-77d5-4879-bea5-6407161fea9a, sled_model: "pheidippes", sled_revision: 1, sled_serial: "9bc396cd-77d5-4879-bea5-6407161fea9a" }, name: "phd-vm-1f862108-4f82-414c-8998-d25fcf8b1a4a", vcpus: 6 }, state: Creating } line = 387 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19242024-08-30T01:18:16.548ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 583 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19252024-08-30T01:18:16.548ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19262024-08-30T01:18:16.548ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::smoke::nproc_test state = Run target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19272024-08-30T01:18:16.549ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19282024-08-30T01:18:16.549ZINFOphd-runner: [WAIT_TO_BOOT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
19292024-08-30T01:18:16.549ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] waiting for guest to boot file = phd-tests/framework/src/test_vm/mod.rs line = 647 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = 300s vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19302024-08-30T01:18:16.549ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::nproc_test step = WaitFor("localhost login: ") target = phd_framework::test_vm
19312024-08-30T01:18:16.549ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19322024-08-30T01:18:16.549ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19332024-08-30T01:18:21.506ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 4956 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19342024-08-30T01:18:21.506ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::nproc_test step = WriteStr("root") target = phd_framework::test_vm
19352024-08-30T01:18:21.506ZDEBGphd-runner: [WAIT_TO_BOOT - EVENT] executing command in boot sequence file = phd-tests/framework/src/test_vm/mod.rs line = 655 path = phd_tests::smoke::nproc_test step = WaitFor("localhost:~#") target = phd_framework::test_vm
19362024-08-30T01:18:21.506ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19372024-08-30T01:18:21.506ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = CallerTimeout vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19382024-08-30T01:18:21.525ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 18 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19392024-08-30T01:18:21.525ZINFOphd-runner: [WAIT_TO_BOOT - EVENT] Guest has booted file = phd-tests/framework/src/test_vm/mod.rs line = 695 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
19402024-08-30T01:18:21.525ZINFOphd-runner: [WAIT_TO_BOOT - END] elapsed_milliseconds = 4976 file = phd-tests/framework/src/test_vm/mod.rs line = 698 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm
19412024-08-30T01:18:21.526ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19422024-08-30T01:18:21.526ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = Explicit(15s) vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19432024-08-30T01:18:21.536ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 10 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19442024-08-30T01:18:21.536ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - START] file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19452024-08-30T01:18:21.536ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console file = phd-tests/framework/src/test_vm/mod.rs line = 720 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm timeout_duration = Explicit(300s) vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19462024-08-30T01:18:21.569ZINFOphd-runner: [WAIT_FOR_SERIAL_OUTPUT - END] elapsed_milliseconds = 32 file = phd-tests/framework/src/test_vm/mod.rs line = 713 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19472024-08-30T01:18:21.569ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19482024-08-30T01:18:21.570ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
19492024-08-30T01:18:21.570ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 5022 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
19502024-08-30T01:18:21.570ZINFOphd-runner: test phd_tests::smoke::nproc_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
19512024-08-30T01:18:21.570ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
19522024-08-30T01:18:21.571ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19532024-08-30T01:18:21.978ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::smoke::nproc_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19542024-08-30T01:18:22.117ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::smoke::nproc_test target = phd_framework::zfs vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19552024-08-30T01:18:22.117ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-69841eeb-5d71-4d5b-8883-28b788fd3bbb"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = destroy vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19562024-08-30T01:18:22.153ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::smoke::nproc_test target = phd_framework::zfs vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19572024-08-30T01:18:22.153ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-f48c5b78-60a6-41df-a5e8-909723431b81"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::smoke::nproc_test target = phd_framework::zfs verb = destroy vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19582024-08-30T01:18:22.177ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 607 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::smoke::nproc_test target = phd_framework::test_vm vm = nproc_test vm_id = 1f862108-4f82-414c-8998-d25fcf8b1a4a
19592024-08-30T01:18:22.177ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 6282 file = phd-tests/tests/src/smoke.rs line = 7 path = phd_tests::smoke::nproc_test target = phd_tests::smoke
19602024-08-30T01:18:22.177ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 607 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
19612024-08-30T01:18:22.177ZINFOphd-runner: Starting test phd_tests::server_state_machine::instance_reset_requires_running_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
19622024-08-30T01:18:22.178ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
19632024-08-30T01:18:22.178ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
19642024-08-30T01:18:22.178ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/server_state_machine.rs line = 83 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_tests::server_state_machine
19652024-08-30T01:18:22.178ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
19662024-08-30T01:18:22.178ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
19672024-08-30T01:18:22.178ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
19682024-08-30T01:18:22.178ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = list
19692024-08-30T01:18:22.192ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_reset_requires_running_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 170M 1.80T 169M /phd-artifacts\n target = phd_framework::zfs
19702024-08-30T01:18:22.192ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-2d346843-20ad-4540-823f-70dca26d5067"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = snapshot
19712024-08-30T01:18:22.211ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-2d346843-20ad-4540-823f-70dca26d5067", "phd-artifacts/phd-clone-06af01d5-b620-4661-b9a5-6d6b511554e8"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = clone
19722024-08-30T01:18:22.230ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-06af01d5-b620-4661-b9a5-6d6b511554e8"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = list
19732024-08-30T01:18:22.243ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_reset_requires_running_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-06af01d5-b620-4661-b9a5-6d6b511554e8 0B 1.80T 169M /phd-artifacts/phd-clone-06af01d5-b620-4661-b9a5-6d6b511554e8\n target = phd_framework::zfs
19742024-08-30T01:18:22.244ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm
19752024-08-30T01:18:22.244ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm_name = instance_reset_requires_running_test
19762024-08-30T01:18:22.244ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
19772024-08-30T01:18:22.244ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_reset_requires_running_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::server_state_machine::instance_reset_requires_running_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
19782024-08-30T01:18:22.244ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::server_state_machine::instance_reset_requires_running_test stderr_path = "/tmp/propolis-phd/instance_reset_requires_running_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_reset_requires_running_test.stdout.log" target = phd_framework::server_log_mode
19792024-08-30T01:18:22.251ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1099 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm::server
19802024-08-30T01:18:22.252ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm
19812024-08-30T01:18:22.252ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19822024-08-30T01:18:22.252ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_requires_running_test state = Reboot target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19832024-08-30T01:18:22.252ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19842024-08-30T01:18:22.252ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19852024-08-30T01:18:22.253ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19862024-08-30T01:18:22.656ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
19872024-08-30T01:18:22.657ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 6e36a73b-0f4c-4756-bb69-5a2cb186e529, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: aa447f03-168a-4631-a7c7-514c47206b31, silo_id: bd3a6217-0d7d-4e9e-9394-94477923dde9, sled_id: 7d22375a-4d54-4a86-9312-6091e4bd505d, sled_model: "pheidippes", sled_revision: 1, sled_serial: "7d22375a-4d54-4a86-9312-6091e4bd505d" }, name: "phd-vm-6e36a73b-0f4c-4756-bb69-5a2cb186e529", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19882024-08-30T01:18:22.657ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 404 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19892024-08-30T01:18:22.657ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19902024-08-30T01:18:22.657ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_requires_running_test state = Run target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19912024-08-30T01:18:22.658ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19922024-08-30T01:18:22.658ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19932024-08-30T01:18:22.658ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19942024-08-30T01:18:22.658ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19952024-08-30T01:18:22.658ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19962024-08-30T01:18:22.658ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19972024-08-30T01:18:22.658ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19982024-08-30T01:18:22.658ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
19992024-08-30T01:18:22.659ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial console command channel was closed file = phd-tests/framework/src/serial/mod.rs line = 213 target = phd_framework::serial
20002024-08-30T01:18:22.659ZINFOphd-runner: test phd_tests::server_state_machine::instance_reset_requires_running_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
20012024-08-30T01:18:22.659ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 2 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
20022024-08-30T01:18:22.659ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
20032024-08-30T01:18:22.659ZDEBGphd-runner: [VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 976 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
20042024-08-30T01:18:23.217ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::server_state_machine::instance_reset_requires_running_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
20052024-08-30T01:18:23.352ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
20062024-08-30T01:18:23.352ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-06af01d5-b620-4661-b9a5-6d6b511554e8"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = destroy vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
20072024-08-30T01:18:23.389ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
20082024-08-30T01:18:23.389ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-2d346843-20ad-4540-823f-70dca26d5067"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::zfs verb = destroy vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
20092024-08-30T01:18:23.410ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 751 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_framework::test_vm vm = instance_reset_requires_running_test vm_id = 6e36a73b-0f4c-4756-bb69-5a2cb186e529
20102024-08-30T01:18:23.411ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 1232 file = phd-tests/tests/src/server_state_machine.rs line = 83 path = phd_tests::server_state_machine::instance_reset_requires_running_test target = phd_tests::server_state_machine
20112024-08-30T01:18:23.411ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 752 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
20122024-08-30T01:18:23.411ZINFOphd-runner: Starting test phd_tests::server_state_machine::instance_reset_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
20132024-08-30T01:18:23.411ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
20142024-08-30T01:18:23.411ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
20152024-08-30T01:18:23.411ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/server_state_machine.rs line = 52 path = phd_tests::server_state_machine::instance_reset_test target = phd_tests::server_state_machine
20162024-08-30T01:18:23.411ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
20172024-08-30T01:18:23.411ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
20182024-08-30T01:18:23.411ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
20192024-08-30T01:18:23.411ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = list
20202024-08-30T01:18:23.424ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_reset_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 170M 1.80T 169M /phd-artifacts\n target = phd_framework::zfs
20212024-08-30T01:18:23.424ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-61b9e176-2ee2-4d56-8234-6714c75b8635"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = snapshot
20222024-08-30T01:18:23.441ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-61b9e176-2ee2-4d56-8234-6714c75b8635", "phd-artifacts/phd-clone-4b7a2316-d5ee-48f6-bc5f-c847f92fe579"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = clone
20232024-08-30T01:18:23.458ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-4b7a2316-d5ee-48f6-bc5f-c847f92fe579"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = list
20242024-08-30T01:18:23.471ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_reset_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-4b7a2316-d5ee-48f6-bc5f-c847f92fe579 0B 1.80T 169M /phd-artifacts/phd-clone-4b7a2316-d5ee-48f6-bc5f-c847f92fe579\n target = phd_framework::zfs
20252024-08-30T01:18:23.472ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm
20262024-08-30T01:18:23.472ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm_name = instance_reset_returns_to_running_test
20272024-08-30T01:18:23.472ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
20282024-08-30T01:18:23.472ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_reset_returns_to_running_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::server_state_machine::instance_reset_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
20292024-08-30T01:18:23.472ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::server_state_machine::instance_reset_test stderr_path = "/tmp/propolis-phd/instance_reset_returns_to_running_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_reset_returns_to_running_test.stdout.log" target = phd_framework::server_log_mode
20302024-08-30T01:18:23.480ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1107 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm::server
20312024-08-30T01:18:23.481ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm
20322024-08-30T01:18:23.481ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20332024-08-30T01:18:23.481ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20342024-08-30T01:18:23.481ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20352024-08-30T01:18:23.481ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20362024-08-30T01:18:23.481ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20372024-08-30T01:18:24.335ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
20382024-08-30T01:18:24.335ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: a07c7380-6fb1-47ea-a759-c90e3a5bbb4c, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 04441d61-f7dc-41a1-ba6f-ba687c91cd2a, silo_id: 647d76de-75b5-4533-b35f-c7bd4a687a59, sled_id: 99b9704e-3b9f-4627-9152-c7ddbb40a3b7, sled_model: "pheidippes", sled_revision: 1, sled_serial: "99b9704e-3b9f-4627-9152-c7ddbb40a3b7" }, name: "phd-vm-a07c7380-6fb1-47ea-a759-c90e3a5bbb4c", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20392024-08-30T01:18:24.335ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 854 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20402024-08-30T01:18:24.335ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20412024-08-30T01:18:24.335ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Run target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20422024-08-30T01:18:24.336ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20432024-08-30T01:18:24.336ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20442024-08-30T01:18:24.336ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20452024-08-30T01:18:24.336ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20462024-08-30T01:18:24.336ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20472024-08-30T01:18:24.337ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20482024-08-30T01:18:24.337ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20492024-08-30T01:18:24.337ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20502024-08-30T01:18:24.337ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20512024-08-30T01:18:24.337ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20522024-08-30T01:18:24.337ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20532024-08-30T01:18:24.337ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20542024-08-30T01:18:24.338ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20552024-08-30T01:18:24.338ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20562024-08-30T01:18:24.343ZINFOphd-runner: [GET - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20572024-08-30T01:18:24.343ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20582024-08-30T01:18:24.344ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20592024-08-30T01:18:24.344ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20602024-08-30T01:18:24.344ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20612024-08-30T01:18:24.344ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20622024-08-30T01:18:24.344ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20632024-08-30T01:18:24.345ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20642024-08-30T01:18:24.345ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20652024-08-30T01:18:24.345ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20662024-08-30T01:18:24.345ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20672024-08-30T01:18:24.345ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20682024-08-30T01:18:24.345ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20692024-08-30T01:18:24.346ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20702024-08-30T01:18:24.346ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20712024-08-30T01:18:24.346ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20722024-08-30T01:18:24.346ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20732024-08-30T01:18:24.346ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20742024-08-30T01:18:24.346ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20752024-08-30T01:18:24.347ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20762024-08-30T01:18:24.347ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20772024-08-30T01:18:24.347ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20782024-08-30T01:18:24.348ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20792024-08-30T01:18:24.348ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20802024-08-30T01:18:24.348ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20812024-08-30T01:18:24.349ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20822024-08-30T01:18:24.349ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20832024-08-30T01:18:24.349ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20842024-08-30T01:18:24.349ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20852024-08-30T01:18:24.349ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20862024-08-30T01:18:24.349ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20872024-08-30T01:18:24.350ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20882024-08-30T01:18:24.350ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20892024-08-30T01:18:24.350ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20902024-08-30T01:18:24.350ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20912024-08-30T01:18:24.350ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20922024-08-30T01:18:24.350ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20932024-08-30T01:18:24.351ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20942024-08-30T01:18:24.351ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20952024-08-30T01:18:24.351ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Stop target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20962024-08-30T01:18:24.351ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20972024-08-30T01:18:24.351ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20982024-08-30T01:18:24.351ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
20992024-08-30T01:18:24.351ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21002024-08-30T01:18:24.351ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21012024-08-30T01:18:24.352ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21022024-08-30T01:18:24.354ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
21032024-08-30T01:18:24.354ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 19 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
21042024-08-30T01:18:25.037ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21052024-08-30T01:18:25.037ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21062024-08-30T01:18:25.038ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21072024-08-30T01:18:25.038ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 686 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21082024-08-30T01:18:25.038ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21092024-08-30T01:18:25.038ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_reset_test state = Reboot target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21102024-08-30T01:18:25.039ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21112024-08-30T01:18:25.039ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21122024-08-30T01:18:25.039ZINFOphd-runner: test phd_tests::server_state_machine::instance_reset_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
21132024-08-30T01:18:25.039ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
21142024-08-30T01:18:25.040ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::server_state_machine::instance_reset_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21152024-08-30T01:18:25.180ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21162024-08-30T01:18:25.180ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-4b7a2316-d5ee-48f6-bc5f-c847f92fe579"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = destroy vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21172024-08-30T01:18:25.215ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21182024-08-30T01:18:25.215ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-61b9e176-2ee2-4d56-8234-6714c75b8635"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::zfs verb = destroy vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21192024-08-30T01:18:25.237ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 198 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::server_state_machine::instance_reset_test target = phd_framework::test_vm vm = instance_reset_returns_to_running_test vm_id = a07c7380-6fb1-47ea-a759-c90e3a5bbb4c
21202024-08-30T01:18:25.237ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 1826 file = phd-tests/tests/src/server_state_machine.rs line = 52 path = phd_tests::server_state_machine::instance_reset_test target = phd_tests::server_state_machine
21212024-08-30T01:18:25.238ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 198 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
21222024-08-30T01:18:25.238ZINFOphd-runner: Starting test phd_tests::server_state_machine::instance_stop_causes_destroy_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
21232024-08-30T01:18:25.238ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
21242024-08-30T01:18:25.238ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
21252024-08-30T01:18:25.238ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/server_state_machine.rs line = 28 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_tests::server_state_machine
21262024-08-30T01:18:25.238ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
21272024-08-30T01:18:25.238ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
21282024-08-30T01:18:25.238ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
21292024-08-30T01:18:25.238ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = list
21302024-08-30T01:18:25.252ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 171M 1.80T 169M /phd-artifacts\n target = phd_framework::zfs
21312024-08-30T01:18:25.252ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-bb03bd14-2f04-4e16-af0d-1259c8a49030"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = snapshot
21322024-08-30T01:18:25.269ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-bb03bd14-2f04-4e16-af0d-1259c8a49030", "phd-artifacts/phd-clone-d19713e4-aa13-4574-8dda-e8e9ad43a7b6"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = clone
21332024-08-30T01:18:25.288ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-d19713e4-aa13-4574-8dda-e8e9ad43a7b6"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = list
21342024-08-30T01:18:25.301ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-d19713e4-aa13-4574-8dda-e8e9ad43a7b6 0B 1.80T 169M /phd-artifacts/phd-clone-d19713e4-aa13-4574-8dda-e8e9ad43a7b6\n target = phd_framework::zfs
21352024-08-30T01:18:25.302ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm
21362024-08-30T01:18:25.302ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm_name = instance_stop_causes_destroy_test
21372024-08-30T01:18:25.302ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
21382024-08-30T01:18:25.302ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_stop_causes_destroy_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
21392024-08-30T01:18:25.302ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test stderr_path = "/tmp/propolis-phd/instance_stop_causes_destroy_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_stop_causes_destroy_test.stdout.log" target = phd_framework::server_log_mode
21402024-08-30T01:18:25.310ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1115 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm::server
21412024-08-30T01:18:25.311ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm
21422024-08-30T01:18:25.311ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21432024-08-30T01:18:25.311ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21442024-08-30T01:18:25.996ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
21452024-08-30T01:18:25.996ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 27381474-a798-4be2-a4ea-3e567f1ed6c7, silo_id: c5be92fc-c8dc-471c-b103-a25c51801236, sled_id: df1baa8d-337b-48cd-81d4-95c962c4068d, sled_model: "pheidippes", sled_revision: 1, sled_serial: "df1baa8d-337b-48cd-81d4-95c962c4068d" }, name: "phd-vm-2b425132-0cc4-4c3f-ab0e-d32c9fb15d63", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21462024-08-30T01:18:25.997ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 685 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21472024-08-30T01:18:25.997ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21482024-08-30T01:18:25.997ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Run target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21492024-08-30T01:18:25.997ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21502024-08-30T01:18:25.997ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21512024-08-30T01:18:25.997ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Stop target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21522024-08-30T01:18:25.998ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21532024-08-30T01:18:25.998ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21542024-08-30T01:18:25.998ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21552024-08-30T01:18:25.998ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21562024-08-30T01:18:25.998ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21572024-08-30T01:18:26.001ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
21582024-08-30T01:18:26.001ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 5 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
21592024-08-30T01:18:26.002ZINFOphd-runner: [GET - END] elapsed_milliseconds = 3 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21602024-08-30T01:18:26.002ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 3 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21612024-08-30T01:18:26.002ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21622024-08-30T01:18:26.002ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Run target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21632024-08-30T01:18:26.003ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21642024-08-30T01:18:26.003ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21652024-08-30T01:18:26.003ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Stop target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21662024-08-30T01:18:26.003ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21672024-08-30T01:18:26.003ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21682024-08-30T01:18:26.003ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test state = Reboot target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21692024-08-30T01:18:26.004ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21702024-08-30T01:18:26.004ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21712024-08-30T01:18:26.004ZINFOphd-runner: test phd_tests::server_state_machine::instance_stop_causes_destroy_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
21722024-08-30T01:18:26.004ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
21732024-08-30T01:18:26.005ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21742024-08-30T01:18:26.143ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21752024-08-30T01:18:26.143ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-d19713e4-aa13-4574-8dda-e8e9ad43a7b6"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = destroy vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21762024-08-30T01:18:26.180ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21772024-08-30T01:18:26.180ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-bb03bd14-2f04-4e16-af0d-1259c8a49030"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::zfs verb = destroy vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21782024-08-30T01:18:26.204ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 200 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_framework::test_vm vm = instance_stop_causes_destroy_test vm_id = 2b425132-0cc4-4c3f-ab0e-d32c9fb15d63
21792024-08-30T01:18:26.205ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 966 file = phd-tests/tests/src/server_state_machine.rs line = 28 path = phd_tests::server_state_machine::instance_stop_causes_destroy_test target = phd_tests::server_state_machine
21802024-08-30T01:18:26.205ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 200 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
21812024-08-30T01:18:26.205ZINFOphd-runner: Starting test phd_tests::server_state_machine::instance_start_stop_test file = phd-tests/runner/src/execute.rs line = 90 target = phd_runner::execute
21822024-08-30T01:18:26.205ZINFOphd-runner: [TEST_SETUP - START] file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
21832024-08-30T01:18:26.205ZINFOphd-runner: [TEST_SETUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 41 target = phd_runner::fixtures
21842024-08-30T01:18:26.205ZINFOphd-runner: [TEST - START] file = phd-tests/tests/src/server_state_machine.rs line = 12 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_tests::server_state_machine
21852024-08-30T01:18:26.205ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd target = phd_framework::artifacts::store
21862024-08-30T01:18:26.205ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
21872024-08-30T01:18:26.205ZDEBGphd-runner: [TEST - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso target = phd_framework::artifacts::store
21882024-08-30T01:18:26.205ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = list
21892024-08-30T01:18:26.220ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_start_stop_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 170M 1.80T 169M /phd-artifacts\n target = phd_framework::zfs
21902024-08-30T01:18:26.220ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-dcf87d29-4773-42d5-b1e0-9da55b505f9a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = snapshot
21912024-08-30T01:18:26.239ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts@phd-dcf87d29-4773-42d5-b1e0-9da55b505f9a", "phd-artifacts/phd-clone-66e5015d-19cf-4b83-a3fd-d6ccc95d6b7d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = clone
21922024-08-30T01:18:26.259ZDEBGphd-runner: [TEST - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-66e5015d-19cf-4b83-a3fd-d6ccc95d6b7d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = list
21932024-08-30T01:18:26.272ZDEBGphd-runner: [TEST - EVENT] parsing zfs list output file = phd-tests/framework/src/zfs.rs line = 238 path = phd_tests::server_state_machine::instance_start_stop_test stdout = NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-66e5015d-19cf-4b83-a3fd-d6ccc95d6b7d 0B 1.80T 169M /phd-artifacts/phd-clone-66e5015d-19cf-4b83-a3fd-d6ccc95d6b7d\n target = phd_framework::zfs
21942024-08-30T01:18:26.272ZINFOphd-runner: [NEW - START] file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm
21952024-08-30T01:18:26.272ZINFOphd-runner: [NEW - EVENT] phd_framework::test_vm environment = EnvironmentSpec { location: Local, propolis_artifact: "__DEFAULT_PROPOLIS" } file = phd-tests/framework/src/test_vm/mod.rs guest_os_kind = Alpine line = 195 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm_name = instance_ensure_running_test
21962024-08-30T01:18:26.272ZDEBGphd-runner: [NEW - EVENT] Verified artifact already exists file = phd-tests/framework/src/artifacts/store.rs line = 45 path = /work/phd-test/propolis-server target = phd_framework::artifacts::store
21972024-08-30T01:18:26.273ZINFOphd-runner: [NEW - EVENT] Launching Propolis server config_toml_path = "/tmp/propolis-phd/instance_ensure_running_test.config.toml" file = phd-tests/framework/src/test_vm/server.rs line = 55 path = phd_tests::server_state_machine::instance_start_stop_test server_addr = 127.0.0.1:9000 server_path = "/work/phd-test/propolis-server" target = phd_framework::test_vm::server
21982024-08-30T01:18:26.273ZINFOphd-runner: [NEW - EVENT] Opening server log files file = phd-tests/framework/src/server_log_mode.rs line = 64 path = phd_tests::server_state_machine::instance_start_stop_test stderr_path = "/tmp/propolis-phd/instance_ensure_running_test.stderr.log" stdout_path = "/tmp/propolis-phd/instance_ensure_running_test.stdout.log" target = phd_framework::server_log_mode
21992024-08-30T01:18:26.280ZINFOphd-runner: [NEW - EVENT] Launched server with pid 1123 file = phd-tests/framework/src/test_vm/server.rs line = 107 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm::server
22002024-08-30T01:18:26.281ZINFOphd-runner: [NEW - END] elapsed_milliseconds = 8 file = phd-tests/framework/src/test_vm/mod.rs line = 177 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm
22012024-08-30T01:18:26.281ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - START] file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22022024-08-30T01:18:26.281ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure e = Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146) file = phd-tests/framework/src/test_vm/mod.rs line = 331 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22032024-08-30T01:18:27.028ZINFOphd-runner: [SERIAL CONSOLE TASK - START] file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
22042024-08-30T01:18:27.028ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - EVENT] Started instance file = phd-tests/framework/src/test_vm/mod.rs instance_description.instance = Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Pheidippides-managed VM", id: 783e5e3e-0068-49f6-9d54-7cbfeb26736e, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: b553bd18-6e3b-49d1-a7bd-da65d36242dc, silo_id: 68ad751c-0af4-43d5-a311-84a68ac52446, sled_id: 8fb60cbc-e2ab-4a12-af60-bc4509380334, sled_model: "pheidippes", sled_revision: 1, sled_serial: "8fb60cbc-e2ab-4a12-af60-bc4509380334" }, name: "phd-vm-783e5e3e-0068-49f6-9d54-7cbfeb26736e", vcpus: 2 }, state: Creating } line = 387 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22052024-08-30T01:18:27.028ZINFOphd-runner: [INSTANCE_ENSURE_INTERNAL - END] elapsed_milliseconds = 747 file = phd-tests/framework/src/test_vm/mod.rs line = 281 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22062024-08-30T01:18:27.028ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22072024-08-30T01:18:27.029ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22082024-08-30T01:18:27.029ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22092024-08-30T01:18:27.029ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22102024-08-30T01:18:27.029ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test state = Run target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22112024-08-30T01:18:27.030ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22122024-08-30T01:18:27.030ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22132024-08-30T01:18:27.030ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22142024-08-30T01:18:27.030ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22152024-08-30T01:18:27.030ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22162024-08-30T01:18:27.030ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22172024-08-30T01:18:27.030ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22182024-08-30T01:18:27.030ZINFOphd-runner: [PUT_INSTANCE_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22192024-08-30T01:18:27.031ZINFOphd-runner: [PUT_INSTANCE_STATE - EVENT] Requesting instance state change file = phd-tests/framework/src/test_vm/mod.rs line = 447 path = phd_tests::server_state_machine::instance_start_stop_test state = Stop target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22202024-08-30T01:18:27.032ZINFOphd-runner: [PUT_INSTANCE_STATE - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 442 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22212024-08-30T01:18:27.032ZINFOphd-runner: [WAIT_FOR_STATE - START] file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22222024-08-30T01:18:27.032ZINFOphd-runner: [WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed file = phd-tests/framework/src/test_vm/mod.rs line = 600 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22232024-08-30T01:18:27.032ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22242024-08-30T01:18:27.032ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22252024-08-30T01:18:27.032ZINFOphd-runner: [GET - END] elapsed_milliseconds = 0 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22262024-08-30T01:18:27.035ZDEBGphd-runner: [SERIAL CONSOLE TASK - EVENT] serial websocket closed file = phd-tests/framework/src/serial/mod.rs line = 271 target = phd_framework::serial
22272024-08-30T01:18:27.035ZINFOphd-runner: [SERIAL CONSOLE TASK - END] elapsed_milliseconds = 7 file = phd-tests/framework/src/serial/mod.rs line = 200 target = phd_framework::serial
22282024-08-30T01:18:27.348ZINFOphd-runner: [GET - START] file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22292024-08-30T01:18:27.349ZINFOphd-runner: [GET - EVENT] Sending instance get request to server file = phd-tests/framework/src/test_vm/mod.rs line = 454 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22302024-08-30T01:18:27.350ZINFOphd-runner: [GET - END] elapsed_milliseconds = 1 file = phd-tests/framework/src/test_vm/mod.rs line = 452 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22312024-08-30T01:18:27.350ZINFOphd-runner: [WAIT_FOR_STATE - END] elapsed_milliseconds = 318 file = phd-tests/framework/src/test_vm/mod.rs line = 594 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22322024-08-30T01:18:27.350ZINFOphd-runner: [VM CLEANUP - START] file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22332024-08-30T01:18:27.350ZINFOphd-runner: test phd_tests::server_state_machine::instance_start_stop_test ... ok file = phd-tests/runner/src/execute.rs line = 129 target = phd_runner::execute
22342024-08-30T01:18:27.350ZINFOphd-runner: [TEST_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
22352024-08-30T01:18:27.351ZDEBGphd-runner: [VM CLEANUP - EVENT] Killing Propolis server process file = phd-tests/framework/src/test_vm/server.rs line = 125 path = phd_tests::server_state_machine::instance_start_stop_test self.address = 127.0.0.1:9000 target = phd_framework::test_vm::server vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22362024-08-30T01:18:27.490ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs clone dropped file = phd-tests/framework/src/zfs.rs line = 83 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22372024-08-30T01:18:27.490ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts/phd-clone-66e5015d-19cf-4b83-a3fd-d6ccc95d6b7d"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = destroy vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22382024-08-30T01:18:27.531ZDEBGphd-runner: [VM CLEANUP - EVENT] zfs snapshot dropped file = phd-tests/framework/src/zfs.rs line = 57 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22392024-08-30T01:18:27.532ZDEBGphd-runner: [VM CLEANUP - EVENT] executing ZFS command args = ["phd-artifacts@phd-dcf87d29-4773-42d5-b1e0-9da55b505f9a"] file = phd-tests/framework/src/zfs.rs line = 304 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::zfs verb = destroy vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22402024-08-30T01:18:27.552ZINFOphd-runner: [VM CLEANUP - END] elapsed_milliseconds = 201 file = phd-tests/framework/src/test_vm/mod.rs line = 953 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_framework::test_vm vm = instance_ensure_running_test vm_id = 783e5e3e-0068-49f6-9d54-7cbfeb26736e
22412024-08-30T01:18:27.552ZINFOphd-runner: [TEST - END] elapsed_milliseconds = 1347 file = phd-tests/tests/src/server_state_machine.rs line = 12 path = phd_tests::server_state_machine::instance_start_stop_test target = phd_tests::server_state_machine
22422024-08-30T01:18:27.552ZINFOphd-runner: [TEST_CLEANUP - END] elapsed_milliseconds = 201 file = phd-tests/runner/src/fixtures.rs line = 51 target = phd_runner::fixtures
22432024-08-30T01:18:27.552ZINFOphd-runner: [EXECUTION_CLEANUP - START] file = phd-tests/runner/src/fixtures.rs line = 35 target = phd_runner::fixtures
22442024-08-30T01:18:27.552ZINFOphd-runner: [EXECUTION_CLEANUP - END] elapsed_milliseconds = 0 file = phd-tests/runner/src/fixtures.rs line = 35 target = phd_runner::fixtures
2245 test result: ok. 25 passed; 0 failed; 1 skipped; 0 not run; finished in 258.33s
2246 
22472024-08-30T01:18:27.553ZDEBGphd-runner: phd_runner exit_code = 0 file = phd-tests/runner/src/main.rs line = 40 target = phd_runner