01HSHEX1XATZ6WBEG7RS9E1E7F: phd-run

BasicConfig {
    output_rules: [
        "/tmp/phd-runner.log",
        "/tmp/phd-tmp-files.tar.gz",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HSHEXEF20799RWG1S2CZ5YMV

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-03-21T21:43:27.932Zjob dependencies complete; ready to run (waiting for 10 m 11 s)
22024-03-22T05:01:00.799Zjob assigned to worker 01HSJ8AEEH0CZ8YMDF0TW30K60 (queued for 7 h 17 m 32 s)
32024-03-22T05:01:00.842Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-03-22T05:01:00.893Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-03-22T05:01:00.930Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-03-22T05:01:00.964Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-03-22T05:01:01.018Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-03-22T05:01:01.053ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-03-22T05:01:01.086Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-03-22T05:01:01.121ZOxide Helios Version helios-2.0.22550 64-bit
112024-03-22T05:01:01.154ZConfiguring devices.
122024-03-22T05:01:01.189Z##################################################
132024-03-22T05:01:01.358Z#### ############# ##
142024-03-22T05:01:01.489Z### ### ############ ##
152024-03-22T05:01:01.587Z## ### # ## ### ## Oxide Computer Company ##
162024-03-22T05:01:01.623Z## ## ## ### # ### ##
172024-03-22T05:01:01.657Z## # ### #### #### This Station Under ##
182024-03-22T05:01:01.690Z### ### #### # ### Computer Control ##
192024-03-22T05:01:01.724Z#### #### ### ## ##
202024-03-22T05:01:01.758Z##################################################
212024-03-22T05:01:01.790ZHostname: buskin
222024-03-22T05:01:01.824ZLoading smf(7) service descriptions:
232024-03-22T05:01:02.709Zdownloading input: /input/phd-build/out/phd-runner.sha256.txt
242024-03-22T05:01:02.735Zdownloaded input: /input/phd-build/out/phd-runner.sha256.txt
252024-03-22T05:01:02.735Zdownloading input: /input/phd-build/out/phd-runner.tar.gz
262024-03-22T05:01:15.207Zdownloaded input: /input/phd-build/out/phd-runner.tar.gz
272024-03-22T05:01:15.234Zdownloading input: /input/phd-build/out/propolis-server-debug.sha256.txt
282024-03-22T05:01:15.274Zdownloaded input: /input/phd-build/out/propolis-server-debug.sha256.txt
292024-03-22T05:01:15.274Zdownloading input: /input/phd-build/out/propolis-server-debug.tar.gz
302024-03-22T05:01:37.739Zdownloaded input: /input/phd-build/out/propolis-server-debug.tar.gz
 
312024-03-22T05:01:37.739Zstarting task 0: "setup"
322024-03-22T05:01:37.765Z++ uname -s
332024-03-22T05:01:37.765Z+ kern=SunOS
342024-03-22T05:01:37.765Z+ case "$kern" in
352024-03-22T05:01:37.765Z+ groupadd -g 12345 build
362024-03-22T05:01:37.765Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
372024-03-22T05:01:39.758Z+ zfs create -o mountpoint=/work rpool/work
382024-03-22T05:01:39.800Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
392024-03-22T05:01:39.825Z+ home_fs=zfs
402024-03-22T05:01:39.825Z+ [[ zfs == autofs ]]
412024-03-22T05:01:39.825Z+ mkdir -p /home/build
422024-03-22T05:01:39.825Z+ chown build:build /home/build /work
432024-03-22T05:01:41.810Z+ chmod 0700 /home/build /work
442024-03-22T05:01:41.836Zprocess exited: duration 4071 ms, exit code 0
 
452024-03-22T05:01:41.887Zstarting task 1: "authentication"
462024-03-22T05:01:41.934Zprocess exited: duration 46 ms, exit code 0
 
472024-03-22T05:01:41.984Zstarting task 2: "build"
482024-03-22T05:01:42.009Z+ indir=/input
492024-03-22T05:01:42.009Z+ indir_suffix='phd-build/out/*.tar.gz'
502024-03-22T05:01:42.009Z+ phddir=/work/phd-test
512024-03-22T05:01:42.009Z+ pfexec zpool create -f phd-artifacts c1t1d0 c2t1d0
522024-03-22T05:01:42.122Z+ artifactdir=/phd-artifacts
532024-03-22T05:01:42.122Z+ banner Inputs
542024-03-22T05:01:42.148Z ###
552024-03-22T05:01:42.148Z # # # ##### # # ##### ####
562024-03-22T05:01:42.148Z # ## # # # # # # #
572024-03-22T05:01:42.148Z # # # # # # # # # ####
582024-03-22T05:01:42.148Z # # # # ##### # # # #
592024-03-22T05:01:42.148Z # # ## # # # # # #
602024-03-22T05:01:42.149Z ### # # # #### # ####
612024-03-22T05:01:42.149Z
622024-03-22T05:01:42.149Z+ find /input -ls
632024-03-22T05:01:42.149Z 34 1 drwxr-xr-x 3 root root 3 Mar 22 05:01 /input
642024-03-22T05:01:42.149Z 2 1 drwxr-xr-x 3 root root 3 Mar 22 05:01 /input/phd-build
652024-03-22T05:01:42.149Z 3 2 drwxr-xr-x 2 root root 6 Mar 22 05:01 /input/phd-build/out
662024-03-22T05:01:42.149Z 129 69724 -rw-r--r-- 1 root root 71351709 Mar 22 05:01 /input/phd-build/out/phd-runner.tar.gz
672024-03-22T05:01:42.149Z 130 126839 -rw-r--r-- 1 root root 129800313 Mar 22 05:01 /input/phd-build/out/propolis-server-debug.tar.gz
682024-03-22T05:01:42.149Z 256 1 -rw-r--r-- 1 root root 65 Mar 22 05:01 /input/phd-build/out/propolis-server-debug.sha256.txt
692024-03-22T05:01:42.149Z 128 1 -rw-r--r-- 1 root root 65 Mar 22 05:01 /input/phd-build/out/phd-runner.sha256.txt
702024-03-22T05:01:42.149Z+ rm -rf /work/phd-test
712024-03-22T05:01:42.149Z+ mkdir /work/phd-test
722024-03-22T05:01:42.149Z+ for p in $indir/$indir_suffix
732024-03-22T05:01:42.149Z+ tar xzvf /input/phd-build/out/phd-runner.tar.gz -C /work/phd-test
742024-03-22T05:01:43.729ZDecompressing '/input/phd-build/out/phd-runner.tar.gz' with '/usr/bin/gzcat'...
752024-03-22T05:01:43.729Zx phd-runner, 260534288 bytes, 508857 tape blocks
762024-03-22T05:01:43.729Zx artifacts.toml, 548 bytes, 2 tape blocks
772024-03-22T05:01:43.754Z++ tar tf /input/phd-build/out/phd-runner.tar.gz
782024-03-22T05:01:45.260Z+ for f in $(tar tf "$p")
792024-03-22T05:01:45.261Z+ chmod +x /work/phd-test/phd-runner
802024-03-22T05:01:45.289Z+ for f in $(tar tf "$p")
812024-03-22T05:01:45.289Z+ chmod +x /work/phd-test/artifacts.toml
822024-03-22T05:01:45.289Z+ for p in $indir/$indir_suffix
832024-03-22T05:01:45.289Z+ tar xzvf /input/phd-build/out/propolis-server-debug.tar.gz -C /work/phd-test
842024-03-22T05:01:48.285ZDecompressing '/input/phd-build/out/propolis-server-debug.tar.gz' with '/usr/bin/gzcat'...
852024-03-22T05:01:48.285Zx propolis-server, 498300808 bytes, 973244 tape blocks
862024-03-22T05:01:48.309Z++ tar tf /input/phd-build/out/propolis-server-debug.tar.gz
872024-03-22T05:01:51.024Z+ for f in $(tar tf "$p")
882024-03-22T05:01:51.024Z+ chmod +x /work/phd-test/propolis-server
892024-03-22T05:01:51.050Z+ ls /work/phd-test
902024-03-22T05:01:51.051Zartifacts.toml
912024-03-22T05:01:51.051Zphd-runner
922024-03-22T05:01:51.051Zpropolis-server
932024-03-22T05:01:51.051Z+ banner Setup
942024-03-22T05:01:51.051Z #####
952024-03-22T05:01:51.051Z# # ###### ##### # # #####
962024-03-22T05:01:51.051Z# # # # # # #
972024-03-22T05:01:51.051Z ##### ##### # # # # #
982024-03-22T05:01:51.051Z # # # # # #####
992024-03-22T05:01:51.051Z# # # # # # #
1002024-03-22T05:01:51.051Z ##### ###### # #### #
1012024-03-22T05:01:51.051Z
1022024-03-22T05:01:51.051Z+ tmpdir=/tmp/propolis-phd
1032024-03-22T05:01:51.051Z+ '[' '!' -d /tmp/propolis-phd ']'
1042024-03-22T05:01:51.051Z+ mkdir /tmp/propolis-phd
1052024-03-22T05:01:51.051Z+ banner Tests
1062024-03-22T05:01:51.051Z#######
1072024-03-22T05:01:51.051Z # ###### #### ##### ####
1082024-03-22T05:01:51.051Z # # # # #
1092024-03-22T05:01:51.051Z # ##### #### # ####
1102024-03-22T05:01:51.051Z # # # # #
1112024-03-22T05:01:51.051Z # # # # # # #
1122024-03-22T05:01:51.051Z # ###### #### # ####
1132024-03-22T05:01:51.052Z
1142024-03-22T05:01:51.052Z+ runner=/work/phd-test/phd-runner
1152024-03-22T05:01:51.052Z+ artifacts=/work/phd-test/artifacts.toml
1162024-03-22T05:01:51.052Z+ propolis=/work/phd-test/propolis-server
1172024-03-22T05:01:51.052Z+ ls /work/phd-test/phd-runner
1182024-03-22T05:01:51.052Z/work/phd-test/phd-runner
1192024-03-22T05:01:51.052Z+ ls /work/phd-test/artifacts.toml
1202024-03-22T05:01:51.052Z/work/phd-test/artifacts.toml
1212024-03-22T05:01:51.052Z+ ls /work/phd-test/propolis-server
1222024-03-22T05:01:51.052Z/work/phd-test/propolis-server
1232024-03-22T05:01:51.052Z+ set +e
1242024-03-22T05:01:51.052Z+ RUST_BACKTRACE=1
1252024-03-22T05:01:51.052Z+ RUST_LOG=info,phd=debug
1262024-03-22T05:01:51.052Z+ ptime -m pfexec /work/phd-test/phd-runner --emit-bunyan run --propolis-server-cmd /work/phd-test/propolis-server --base-propolis-branch master --crucible-downstairs-commit auto --artifact-toml-path /work/phd-test/artifacts.toml --tmp-directory /tmp/propolis-phd --artifact-directory /phd-artifacts
1272024-03-22T05:01:51.052Z+ tee /tmp/phd-runner.log
1282024-03-22T05:01:51.078Z{"v":0,"name":"phd-runner","msg":"phd_runner","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:50.870345977Z","target":"phd_runner","line":35,"file":"phd-tests/runner/src/main.rs","runner_args":"ProcessArgs { command: Run(RunOptions { propolis_server_cmd: \"/work/phd-test/propolis-server\", base_propolis_branch: Some(\"master\"), base_propolis_commit: None, base_propolis_cmd: None, crucible_downstairs_cmd: None, crucible_downstairs_commit: Some(Auto), tmp_directory: \"/tmp/propolis-phd\", artifact_directory: Some(\"/phd-artifacts\"), server_logging_mode: TmpFile, default_guest_cpus: 2, default_guest_memory_mib: 512, artifact_toml_path: \"/work/phd-test/artifacts.toml\", default_guest_artifact: \"alpine\", default_bootrom_artifact: \"ovmf\", include_filter: [], exclude_filter: [], max_buildomat_wait_secs: 1200 }), disable_ansi: false, emit_bunyan: true }"}
1292024-03-22T05:01:51.078Z{"v":0,"name":"phd-runner","msg":"Created new artifact store from manifest","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:50.872696889Z","target":"phd_framework::artifacts::store","line":221,"file":"phd-tests/framework/src/artifacts/store.rs","store":"Store { local_dir: \"/phd-artifacts\", artifacts: {\"alpine\": Mutex { data: StoredArtifact { description: Artifact { filename: \"alpine.iso\", kind: GuestOs(Alpine), source: RemoteServer { sha256: \"ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1\" }, untar: None }, cached_path: None } }, \"ovmf\": Mutex { data: StoredArtifact { description: Artifact { filename: \"OVMF_CODE.fd\", kind: Bootrom, source: Buildomat(BuildomatArtifact { repo: Repo(\"oxidecomputer/edk2\"), series: Series(\"image_debug\"), commit: Commit(\"6d92acf0a22718dd4175d7c64dbcf7aaec3740bd\"), sha256: \"29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f\" }), untar: None }, cached_path: None } }}, downloader: DownloadConfig { timeout: 600s, buildomat_backoff: ExponentialBackoff { current_interval: 1s, initial_interval: 1s, randomization_factor: 0.5, multiplier: 1.5, max_interval: 60s, start_time: Instant { tv_sec: 369, tv_nsec: 987420920 }, max_elapsed_time: Some(1200s), clock: SystemClock }, remote_server_uris: [\"https://oxide-omicron-build.s3.amazonaws.com\"] } }"}
1302024-03-22T05:01:51.078Z{"v":0,"name":"phd-runner","msg":"Adding Propolis server from local command","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:50.872751171Z","target":"phd_framework::artifacts::store","line":229,"file":"phd-tests/framework/src/artifacts/store.rs","propolis_server_cmd":"/work/phd-test/propolis-server"}
1312024-03-22T05:01:51.078Z{"v":0,"name":"phd-runner","msg":"Adding crucible-downstairs from Buildomat Git revision","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:50.872845084Z","target":"phd_framework::artifacts::store","line":313,"file":"phd-tests/framework/src/artifacts/store.rs","commit":"952c7d60d22be5198b892bec8d92f4291b9160c2"}
1322024-03-22T05:01:51.078Z{"v":0,"name":"phd-runner","msg":"Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:50.872958647Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/crucible/nightly-image/952c7d60d22be5198b892bec8d92f4291b9160c2/crucible-nightly.sha256.txt","timeout":"600s"}
1332024-03-22T05:01:51.285Z{"v":0,"name":"phd-runner","msg":"Adding 'current' Propolis server from Buildomat Git branch 'master'","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.08348587Z","target":"phd_framework::artifacts::store","line":250,"file":"phd-tests/framework/src/artifacts/store.rs"}
1342024-03-22T05:01:51.706Z{"v":0,"name":"phd-runner","msg":"Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.504561686Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","timeout":"600s","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/propolis/phd_build/fdf0585c6a227a7cfbee4a61a36938c3d77e4712/propolis-server.sha256.txt"}
1352024-03-22T05:01:51.836Z{"v":0,"name":"phd-runner","msg":"[EXECUTION_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.634679604Z","target":"phd_runner::fixtures","line":25,"file":"phd-tests/runner/src/fixtures.rs"}
1362024-03-22T05:01:51.862Z{"v":0,"name":"phd-runner","msg":"[EXECUTION_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.634748916Z","target":"phd_runner::fixtures","line":25,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
1372024-03-22T05:01:51.862Z{"v":0,"name":"phd-runner","msg":"Running 22 test(s)","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.63488704Z","target":"phd_runner::execute","line":82,"file":"phd-tests/runner/src/execute.rs"}
1382024-03-22T05:01:51.862Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::smoke::instance_spec_get_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.634961232Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
1392024-03-22T05:01:51.862Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.634990063Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
1402024-03-22T05:01:51.862Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.635018454Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
1412024-03-22T05:01:51.862Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.635236041Z","target":"phd_tests::smoke","line":18,"file":"phd-tests/tests/src/smoke.rs","path":"phd_tests::smoke::instance_spec_get_test"}
1422024-03-22T05:01:51.862Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] checking for existing copy of artifact","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.635433707Z","target":"phd_framework::artifacts::store","line":89,"file":"phd-tests/framework/src/artifacts/store.rs","maybe_path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::smoke::instance_spec_get_test"}
1432024-03-22T05:01:51.862Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:51.635565401Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","timeout":"600s","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/edk2/image_debug/6d92acf0a22718dd4175d7c64dbcf7aaec3740bd/OVMF_CODE.fd","path":"phd_tests::smoke::instance_spec_get_test"}
1442024-03-22T05:01:52.500Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] checking for existing copy of artifact","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:52.298261218Z","target":"phd_framework::artifacts::store","line":89,"file":"phd-tests/framework/src/artifacts/store.rs","maybe_path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::smoke::instance_spec_get_test"}
1452024-03-22T05:01:52.525Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Downloading alpine.iso from https://oxide-omicron-build.s3.amazonaws.com/alpine.iso","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:01:52.298491435Z","target":"phd_framework::artifacts::store","line":618,"file":"phd-tests/framework/src/artifacts/store.rs","timeout":"600s","path":"phd_tests::smoke::instance_spec_get_test"}
1462024-03-22T05:02:21.529Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.327447761Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::smoke::instance_spec_get_test"}
1472024-03-22T05:02:21.554Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.327542784Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","verb":"list","path":"phd_tests::smoke::instance_spec_get_test"}
1482024-03-22T05:02:21.554Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.348383906Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 2.00M 1.80T 1.91M /phd-artifacts\n","path":"phd_tests::smoke::instance_spec_get_test"}
1492024-03-22T05:02:21.554Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.348601203Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-876287d1-6b0f-4962-bf50-05c066d76703\"]","verb":"snapshot","path":"phd_tests::smoke::instance_spec_get_test"}
1502024-03-22T05:02:21.599Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.39819946Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-876287d1-6b0f-4962-bf50-05c066d76703\", \"phd-artifacts/phd-clone-8993e24b-3811-49b5-8d40-70277a5434a4\"]","verb":"clone","path":"phd_tests::smoke::instance_spec_get_test"}
1512024-03-22T05:02:21.627Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.414453231Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-8993e24b-3811-49b5-8d40-70277a5434a4\"]","path":"phd_tests::smoke::instance_spec_get_test"}
1522024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.424859491Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-8993e24b-3811-49b5-8d40-70277a5434a4 0B 1.80T 48.9M /phd-artifacts/phd-clone-8993e24b-3811-49b5-8d40-70277a5434a4\n","path":"phd_tests::smoke::instance_spec_get_test"}
1532024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.425611374Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::instance_spec_get_test"}
1542024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.425757859Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"instance_spec_test","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-8993e24b-3811-49b5-8d40-70277a5434a4/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 3072 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::smoke::instance_spec_get_test"}
1552024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Examining locally-sourced artifact","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.425874522Z","target":"phd_framework::artifacts::store","line":56,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","sha256":"None","path":"phd_tests::smoke::instance_spec_get_test"}
1562024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Locally-sourced artifact is valid, caching its path","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.425919504Z","target":"phd_framework::artifacts::store","line":69,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::smoke::instance_spec_get_test"}
1572024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.426001066Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","config_toml_path":"\"/tmp/propolis-phd/instance_spec_test.config.toml\"","server_addr":"127.0.0.1:9000","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::smoke::instance_spec_get_test"}
1582024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.426069478Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/instance_spec_test.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/instance_spec_test.stderr.log\"","path":"phd_tests::smoke::instance_spec_get_test"}
1592024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 863","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.430695391Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::smoke::instance_spec_get_test"}
1602024-03-22T05:02:21.680Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.431113173Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::instance_spec_get_test","elapsed_milliseconds":5}
1612024-03-22T05:02:21.681Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.43132625Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1622024-03-22T05:02:21.681Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:21.432197237Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1632024-03-22T05:02:22.471Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.269003765Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
1642024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.270081679Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 7b393881-dcce-473b-8168-7faf0cfe9657, image_id: 00000000-0000-0000-0000-000000000000, memory: 3072, metadata: InstanceMetadata { project_id: fdd967f2-1ad6-435f-ab70-05524dbd45e4, silo_id: fe3f00de-ece1-4229-a7fa-36076f52d1f7 }, name: \"phd-vm-7b393881-dcce-473b-8168-7faf0cfe9657\", vcpus: 4 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-8993e24b-3811-49b5-8d40-70277a5434a4/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 3072 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1652024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.270195132Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_spec_test","path":"phd_tests::smoke::instance_spec_get_test","elapsed_milliseconds":838,"vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657"}
1662024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.270277125Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1672024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.270317886Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1682024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.270919064Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_spec_test","path":"phd_tests::smoke::instance_spec_get_test","elapsed_milliseconds":0,"vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657"}
1692024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[GET_SPEC - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.270976456Z","target":"phd_framework::test_vm","line":458,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1702024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[GET_SPEC - EVENT] Sending instance spec get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.271017287Z","target":"phd_framework::test_vm","line":460,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1712024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[GET_SPEC - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.271925075Z","target":"phd_framework::test_vm","line":458,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_spec_test","path":"phd_tests::smoke::instance_spec_get_test","elapsed_milliseconds":0,"vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657"}
1722024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.272013978Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1732024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.272185403Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
1742024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"test phd_tests::smoke::instance_spec_get_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.272226475Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
1752024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.272311177Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
1762024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.272356439Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":3}
1772024-03-22T05:02:22.519Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.272662658Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1782024-03-22T05:02:23.109Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:22.907984663Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1792024-03-22T05:02:23.659Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.457244026Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1802024-03-22T05:02:23.684Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.457345469Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-8993e24b-3811-49b5-8d40-70277a5434a4\"]","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1812024-03-22T05:02:23.710Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.486766165Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1822024-03-22T05:02:23.710Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.486817207Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-876287d1-6b0f-4962-bf50-05c066d76703\"]","vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657","path":"phd_tests::smoke::instance_spec_get_test","vm":"instance_spec_test"}
1832024-03-22T05:02:23.710Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.503840031Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_spec_test","path":"phd_tests::smoke::instance_spec_get_test","elapsed_milliseconds":1231,"vm_id":"7b393881-dcce-473b-8168-7faf0cfe9657"}
1842024-03-22T05:02:23.710Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.503948624Z","target":"phd_tests::smoke","line":18,"file":"phd-tests/tests/src/smoke.rs","path":"phd_tests::smoke::instance_spec_get_test","elapsed_milliseconds":31868}
1852024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504097799Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":1231}
1862024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::smoke::nproc_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504156801Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
1872024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504185522Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
1882024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504213533Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
1892024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504322576Z","target":"phd_tests::smoke","line":7,"file":"phd-tests/tests/src/smoke.rs","path":"phd_tests::smoke::nproc_test"}
1902024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504384768Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::smoke::nproc_test"}
1912024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504533802Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::smoke::nproc_test"}
1922024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504582564Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::smoke::nproc_test"}
1932024-03-22T05:02:23.711Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.504624295Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::smoke::nproc_test"}
1942024-03-22T05:02:23.736Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.515034816Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.1M 1.80T 48.9M /phd-artifacts\n","path":"phd_tests::smoke::nproc_test"}
1952024-03-22T05:02:23.736Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.515139539Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-543414ee-0b4a-4e49-a3c4-fff9447d280b\"]","path":"phd_tests::smoke::nproc_test"}
1962024-03-22T05:02:23.736Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.528781109Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-543414ee-0b4a-4e49-a3c4-fff9447d280b\", \"phd-artifacts/phd-clone-1a6e8803-3f1d-44fe-bafb-1ae1ce24683c\"]","path":"phd_tests::smoke::nproc_test"}
1972024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.543632006Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-1a6e8803-3f1d-44fe-bafb-1ae1ce24683c\"]","verb":"list","path":"phd_tests::smoke::nproc_test"}
1982024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.553456309Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-1a6e8803-3f1d-44fe-bafb-1ae1ce24683c 0B 1.80T 48.9M /phd-artifacts/phd-clone-1a6e8803-3f1d-44fe-bafb-1ae1ce24683c\n","path":"phd_tests::smoke::nproc_test"}
1992024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.553982405Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test"}
2002024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.554056647Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-1a6e8803-3f1d-44fe-bafb-1ae1ce24683c/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 6, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_name":"nproc_test","path":"phd_tests::smoke::nproc_test"}
2012024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.554120329Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::smoke::nproc_test"}
2022024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.554183202Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","config_toml_path":"\"/tmp/propolis-phd/nproc_test.config.toml\"","server_addr":"127.0.0.1:9000","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::smoke::nproc_test"}
2032024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.554218912Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/nproc_test.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/nproc_test.stderr.log\"","path":"phd_tests::smoke::nproc_test"}
2042024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 871","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.5586845Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::smoke::nproc_test"}
2052024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.558951308Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","elapsed_milliseconds":4}
2062024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.559043861Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2072024-03-22T05:02:23.763Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:23.559616189Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2082024-03-22T05:02:24.246Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.045009106Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
2092024-03-22T05:02:24.305Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.045878652Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-1a6e8803-3f1d-44fe-bafb-1ae1ce24683c/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 6, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 7e8b35f5-1b21-47f4-833e-69404dfeed76, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 9905c86a-8f76-4f6f-b0cf-f8c7228b41c6, silo_id: 12136c96-e4e0-45fc-a121-243a1eac73f1 }, name: \"phd-vm-7e8b35f5-1b21-47f4-833e-69404dfeed76\", vcpus: 6 }, state: Creating }","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2102024-03-22T05:02:24.305Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.045971355Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","vm":"nproc_test","elapsed_milliseconds":486}
2112024-03-22T05:02:24.305Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.046028987Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2122024-03-22T05:02:24.306Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.046066388Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2132024-03-22T05:02:24.306Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.046605695Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","vm":"nproc_test","elapsed_milliseconds":0}
2142024-03-22T05:02:24.306Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.046693797Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test"}
2152024-03-22T05:02:24.306Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.046740359Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"300s","vm":"nproc_test","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test"}
2162024-03-22T05:02:24.306Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.04677802Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::smoke::nproc_test"}
2172024-03-22T05:02:24.306Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.046814661Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2182024-03-22T05:02:24.306Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:24.046849952Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2192024-03-22T05:02:29.173Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.971757571Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","vm":"nproc_test","elapsed_milliseconds":4924}
2202024-03-22T05:02:29.173Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.971835863Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::smoke::nproc_test"}
2212024-03-22T05:02:29.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.972077911Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::smoke::nproc_test"}
2222024-03-22T05:02:29.199Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.972129562Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2232024-03-22T05:02:29.199Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.972165064Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost:~#","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2242024-03-22T05:02:29.199Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.99186807Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","vm":"nproc_test","elapsed_milliseconds":19}
2252024-03-22T05:02:29.199Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.991961803Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test"}
2262024-03-22T05:02:29.199Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.991995004Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","elapsed_milliseconds":4945}
2272024-03-22T05:02:29.199Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.992136099Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2282024-03-22T05:02:29.199Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:28.992201581Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"nproc","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2292024-03-22T05:02:29.237Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.000717623Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","vm":"nproc_test","elapsed_milliseconds":8}
2302024-03-22T05:02:29.237Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.000915019Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2312024-03-22T05:02:29.237Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.000988581Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2322024-03-22T05:02:29.268Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.033738069Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","vm":"nproc_test","elapsed_milliseconds":32}
2332024-03-22T05:02:29.268Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.033857233Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2342024-03-22T05:02:29.268Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.03407833Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
2352024-03-22T05:02:29.268Z{"v":0,"name":"phd-runner","msg":"test phd_tests::smoke::nproc_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.034144682Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
2362024-03-22T05:02:29.268Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.034243815Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":4989}
2372024-03-22T05:02:29.268Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.034274206Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
2382024-03-22T05:02:29.268Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.035131052Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2392024-03-22T05:02:29.755Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.552481534Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2402024-03-22T05:02:29.881Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.671700746Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2412024-03-22T05:02:29.913Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.671793769Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-1a6e8803-3f1d-44fe-bafb-1ae1ce24683c\"]","verb":"destroy","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2422024-03-22T05:02:29.913Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.696070206Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2432024-03-22T05:02:29.913Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.696127578Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-543414ee-0b4a-4e49-a3c4-fff9447d280b\"]","verb":"destroy","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","path":"phd_tests::smoke::nproc_test","vm":"nproc_test"}
2442024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.713460181Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::smoke::nproc_test","vm_id":"7e8b35f5-1b21-47f4-833e-69404dfeed76","vm":"nproc_test","elapsed_milliseconds":679}
2452024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.713515223Z","target":"phd_tests::smoke","line":7,"file":"phd-tests/tests/src/smoke.rs","path":"phd_tests::smoke::nproc_test","elapsed_milliseconds":6209}
2462024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.713706859Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":679}
2472024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::hw::lspci_lifecycle_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.713761221Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
2482024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.713788092Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
2492024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.713815023Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
2502024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.713987808Z","target":"phd_tests::hw","line":8,"file":"phd-tests/tests/src/hw.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
2512024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.714100191Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::hw::lspci_lifecycle_test"}
2522024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.714272606Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::hw::lspci_lifecycle_test"}
2532024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.714321128Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::hw::lspci_lifecycle_test"}
2542024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.71437108Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::hw::lspci_lifecycle_test"}
2552024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.725879444Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.1M 1.80T 48.9M /phd-artifacts\n","path":"phd_tests::hw::lspci_lifecycle_test"}
2562024-03-22T05:02:29.940Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.725956346Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-7d3428d6-95dc-4ddb-ada5-47272758d28f\"]","verb":"snapshot","path":"phd_tests::hw::lspci_lifecycle_test"}
2572024-03-22T05:02:29.966Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.742593659Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-7d3428d6-95dc-4ddb-ada5-47272758d28f\", \"phd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f\"]","path":"phd_tests::hw::lspci_lifecycle_test"}
2582024-03-22T05:02:29.966Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.759222211Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f\"]","verb":"list","path":"phd_tests::hw::lspci_lifecycle_test"}
2592024-03-22T05:02:29.992Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.768680432Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f 0B 1.80T 48.9M /phd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f\n","path":"phd_tests::hw::lspci_lifecycle_test"}
2602024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.769212618Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
2612024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.769288611Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"lspci_lifecycle_test","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::hw::lspci_lifecycle_test"}
2622024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.769354173Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::hw::lspci_lifecycle_test"}
2632024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.769418715Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9000","config_toml_path":"\"/tmp/propolis-phd/lspci_lifecycle_test.config.toml\"","path":"phd_tests::hw::lspci_lifecycle_test"}
2642024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.769457406Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/lspci_lifecycle_test.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/lspci_lifecycle_test.stderr.log\"","path":"phd_tests::hw::lspci_lifecycle_test"}
2652024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 879","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.773713877Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
2662024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.774010056Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","elapsed_milliseconds":4}
2672024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.774075168Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2682024-03-22T05:02:29.993Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:29.774559393Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2692024-03-22T05:02:30.848Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.644981757Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
2702024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.645824943Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 2017c903-6df3-41dc-bfb1-c72a9970de88, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 7dce9507-ad16-4fed-9aca-222b0768c0df, silo_id: b3a28075-4a6a-4e50-9770-fad0b670152e }, name: \"phd-vm-2017c903-6df3-41dc-bfb1-c72a9970de88\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2712024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.645980308Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":871,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2722024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.646092391Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2732024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.646162093Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2742024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.646742591Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":0,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2752024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.646793542Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
2762024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.646835324Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"300s","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88","path":"phd_tests::hw::lspci_lifecycle_test"}
2772024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.646867445Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::hw::lspci_lifecycle_test"}
2782024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.646899116Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2792024-03-22T05:02:30.912Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:30.646929117Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2802024-03-22T05:02:35.082Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.880542298Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":4233,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2812024-03-22T05:02:35.083Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.8806217Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::hw::lspci_lifecycle_test"}
2822024-03-22T05:02:35.108Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.880791045Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::hw::lspci_lifecycle_test"}
2832024-03-22T05:02:35.108Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.880841357Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2842024-03-22T05:02:35.108Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.880874848Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2852024-03-22T05:02:35.108Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.899610775Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":18,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2862024-03-22T05:02:35.109Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.899690678Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
2872024-03-22T05:02:35.109Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.899722228Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","elapsed_milliseconds":4252}
2882024-03-22T05:02:35.109Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.899853023Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2892024-03-22T05:02:35.109Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.899895734Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sudo lspci -vvx","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2902024-03-22T05:02:35.134Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.910282164Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":10,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2912024-03-22T05:02:35.134Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.910413048Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2922024-03-22T05:02:35.134Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.910452059Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2932024-03-22T05:02:35.160Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.942074053Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":31,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2942024-03-22T05:02:35.160Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.942275439Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2952024-03-22T05:02:35.160Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.942351461Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sudo lshw -notime","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2962024-03-22T05:02:35.160Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.952782433Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":10,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2972024-03-22T05:02:35.160Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.952941677Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2982024-03-22T05:02:35.160Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.952992899Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
2992024-03-22T05:02:35.187Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.985800059Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":32,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
3002024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] stopping and starting VM for lifecycle test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.985971924Z","target":"phd_framework::lifecycle","line":58,"file":"phd-tests/framework/src/lifecycle.rs","vm_name":"lspci_lifecycle_test","path":"phd_tests::hw::lspci_lifecycle_test"}
3012024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.986060827Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
3022024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.986126589Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Stop","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
3032024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.986927124Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":0,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
3042024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.986988316Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
3052024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.987059158Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"lspci_lifecycle_test_lifecycle_0","path":"phd_tests::hw::lspci_lifecycle_test"}
3062024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.98712344Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::hw::lspci_lifecycle_test"}
3072024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.987195562Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.config.toml\"","server_addr":"127.0.0.1:9002","path":"phd_tests::hw::lspci_lifecycle_test"}
3082024-03-22T05:02:35.214Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.987233503Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stderr.log\"","path":"phd_tests::hw::lspci_lifecycle_test"}
3092024-03-22T05:02:35.215Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 880","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.993598589Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
3102024-03-22T05:02:35.215Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.99394052Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","elapsed_milliseconds":6}
3112024-03-22T05:02:35.215Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.994008912Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3122024-03-22T05:02:35.215Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.994418095Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3132024-03-22T05:02:35.215Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial websocket closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.994645242Z","target":"phd_framework::serial","line":271,"file":"phd-tests/framework/src/serial/mod.rs"}
3142024-03-22T05:02:35.215Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:34.994729484Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":4349}
3152024-03-22T05:02:35.965Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.7635434Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
3162024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.764254391Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: bea6d78c-31ac-4881-9344-bef09b8baeff, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 50bddacf-4985-4ef6-a341-905d37c413c9, silo_id: 9d61b115-7ea4-4134-b88b-d75f20d7f1f5 }, name: \"phd-vm-bea6d78c-31ac-4881-9344-bef09b8baeff\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3172024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.764357935Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":770,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3182024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.764426947Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3192024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.764461488Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3202024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.764953593Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":0,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3212024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.765011835Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
3222024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.765053806Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"lspci_lifecycle_test_lifecycle_0","timeout_duration":"300s","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff","path":"phd_tests::hw::lspci_lifecycle_test"}
3232024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.765086757Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::hw::lspci_lifecycle_test"}
3242024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.765119638Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3252024-03-22T05:02:36.013Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:35.765151969Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3262024-03-22T05:02:40.173Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.971788309Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":4206,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3272024-03-22T05:02:40.173Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.971850861Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::hw::lspci_lifecycle_test"}
3282024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.972007936Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::hw::lspci_lifecycle_test"}
3292024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.972053337Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3302024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.972087598Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3312024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.99197876Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":19,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3322024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.992029962Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test"}
3332024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.992060293Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","elapsed_milliseconds":4227}
3342024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.992122425Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
3352024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.99228536Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3362024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.992329891Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sudo lspci -vvx","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3372024-03-22T05:02:40.198Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:39.993235139Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
3382024-03-22T05:02:40.314Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.113260086Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test","elapsed_milliseconds":120,"vm_id":"2017c903-6df3-41dc-bfb1-c72a9970de88"}
3392024-03-22T05:02:40.344Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.114268717Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":121,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3402024-03-22T05:02:40.344Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.114551155Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3412024-03-22T05:02:40.344Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.114601307Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3422024-03-22T05:02:40.344Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.137073719Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":22,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3432024-03-22T05:02:40.344Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.137360598Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3442024-03-22T05:02:40.344Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.137464981Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sudo lshw -notime","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3452024-03-22T05:02:40.370Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.147737037Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":10,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3462024-03-22T05:02:40.370Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.147884912Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3472024-03-22T05:02:40.371Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.147940114Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3482024-03-22T05:02:40.428Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.180498546Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":32,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3492024-03-22T05:02:40.428Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.180598529Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3502024-03-22T05:02:40.429Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.180791655Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
3512024-03-22T05:02:40.429Z{"v":0,"name":"phd-runner","msg":"test phd_tests::hw::lspci_lifecycle_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.180888668Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
3522024-03-22T05:02:40.429Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.18094405Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":4417}
3532024-03-22T05:02:40.429Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.181021392Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
3542024-03-22T05:02:40.429Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.18191474Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3552024-03-22T05:02:41.087Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:40.885832237Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3562024-03-22T05:02:41.205Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.003391826Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3572024-03-22T05:02:41.231Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.00352833Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-8439a7f2-957e-4485-9b47-4f3647f2a75f\"]","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3582024-03-22T05:02:41.231Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.027457217Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3592024-03-22T05:02:41.231Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.027510309Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-7d3428d6-95dc-4ddb-ada5-47272758d28f\"]","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3602024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.045301797Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::hw::lspci_lifecycle_test","vm":"lspci_lifecycle_test_lifecycle_0","elapsed_milliseconds":864,"vm_id":"bea6d78c-31ac-4881-9344-bef09b8baeff"}
3612024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.045367419Z","target":"phd_tests::hw","line":8,"file":"phd-tests/tests/src/hw.rs","path":"phd_tests::hw::lspci_lifecycle_test","elapsed_milliseconds":11331}
3622024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.045551574Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":864}
3632024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::server_state_machine::instance_reset_requires_running_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.045626897Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
3642024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.045663568Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
3652024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.045698839Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
3662024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.045810432Z","target":"phd_tests::server_state_machine","line":83,"file":"phd-tests/tests/src/server_state_machine.rs","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3672024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.045876624Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3682024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.046032729Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3692024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.046080751Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3702024-03-22T05:02:41.257Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.046137613Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3712024-03-22T05:02:41.282Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.056281265Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.5M 1.80T 48.9M /phd-artifacts\n","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3722024-03-22T05:02:41.282Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.056366387Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-365a47ce-2a22-4ac7-bb30-f74ca5bfa905\"]","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3732024-03-22T05:02:41.282Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.070406Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-365a47ce-2a22-4ac7-bb30-f74ca5bfa905\", \"phd-artifacts/phd-clone-7610f7fd-f4c9-47f9-801d-5e3059cd4256\"]","verb":"clone","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3742024-03-22T05:02:41.308Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.088870858Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-7610f7fd-f4c9-47f9-801d-5e3059cd4256\"]","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3752024-03-22T05:02:41.308Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.098631719Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-7610f7fd-f4c9-47f9-801d-5e3059cd4256 0B 1.80T 48.9M /phd-artifacts/phd-clone-7610f7fd-f4c9-47f9-801d-5e3059cd4256\n","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3762024-03-22T05:02:41.308Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.099111634Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3772024-03-22T05:02:41.308Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.099183836Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-7610f7fd-f4c9-47f9-801d-5e3059cd4256/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_name":"instance_reset_requires_running_test","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","guest_os_kind":"Alpine","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3782024-03-22T05:02:41.308Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.099250448Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3792024-03-22T05:02:41.308Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.09931863Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/instance_reset_requires_running_test.config.toml\"","server_addr":"127.0.0.1:9000","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3802024-03-22T05:02:41.309Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.099357371Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/instance_reset_requires_running_test.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/instance_reset_requires_running_test.stderr.log\"","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3812024-03-22T05:02:41.309Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 889","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.103770437Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3822024-03-22T05:02:41.309Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.104128868Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4,"path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3832024-03-22T05:02:41.309Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.104225771Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3842024-03-22T05:02:41.309Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.104281453Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3852024-03-22T05:02:41.309Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.104677105Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test","elapsed_milliseconds":0}
3862024-03-22T05:02:41.309Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.104733957Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3872024-03-22T05:02:41.309Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.105021106Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3882024-03-22T05:02:41.975Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.768882669Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
3892024-03-22T05:02:42.024Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.769708725Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-7610f7fd-f4c9-47f9-801d-5e3059cd4256/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 00327723-3844-4993-acdb-5b2b8d5a53e9, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: c5d09357-ea86-43a6-abd2-af49cd6cd3cb, silo_id: 34b71307-67ba-4a19-956c-7ff64dc07849 }, name: \"phd-vm-00327723-3844-4993-acdb-5b2b8d5a53e9\", vcpus: 2 }, state: Creating }","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3902024-03-22T05:02:42.024Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.769817518Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test","elapsed_milliseconds":665}
3912024-03-22T05:02:42.024Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.76988249Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3922024-03-22T05:02:42.024Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.769918841Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3932024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.770467148Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test","elapsed_milliseconds":0}
3942024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.77053337Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3952024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.770572321Z","target":"phd_framework::test_vm","line":598,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3962024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.770633283Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3972024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.770669404Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
3982024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.77117441Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test","elapsed_milliseconds":0}
3992024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.771220551Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test","elapsed_milliseconds":0}
4002024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.771272783Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
4012024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.771391567Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
4022024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"test phd_tests::server_state_machine::instance_reset_requires_running_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.771461489Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
4032024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.771472649Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":2}
4042024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.771530391Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
4052024-03-22T05:02:42.025Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:41.772238803Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
4062024-03-22T05:02:42.390Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.189300666Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
4072024-03-22T05:02:42.510Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.309156757Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
4082024-03-22T05:02:42.534Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.30926423Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-7610f7fd-f4c9-47f9-801d-5e3059cd4256\"]","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
4092024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.33882052Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
4102024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.338876912Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-365a47ce-2a22-4ac7-bb30-f74ca5bfa905\"]","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
4112024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.355832154Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"00327723-3844-4993-acdb-5b2b8d5a53e9","vm":"instance_reset_requires_running_test","path":"phd_tests::server_state_machine::instance_reset_requires_running_test","elapsed_milliseconds":584}
4122024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.355898696Z","target":"phd_tests::server_state_machine","line":83,"file":"phd-tests/tests/src/server_state_machine.rs","elapsed_milliseconds":1310,"path":"phd_tests::server_state_machine::instance_reset_requires_running_test"}
4132024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.356059681Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":584}
4142024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::server_state_machine::instance_reset_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.356116313Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
4152024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.356145234Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
4162024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.356171815Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
4172024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.356280228Z","target":"phd_tests::server_state_machine","line":52,"file":"phd-tests/tests/src/server_state_machine.rs","path":"phd_tests::server_state_machine::instance_reset_test"}
4182024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.35635323Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::server_state_machine::instance_reset_test"}
4192024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.356507705Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::server_state_machine::instance_reset_test"}
4202024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.356559847Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::server_state_machine::instance_reset_test"}
4212024-03-22T05:02:42.560Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.356612018Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","verb":"list","path":"phd_tests::server_state_machine::instance_reset_test"}
4222024-03-22T05:02:42.585Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.366784591Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 49.9M 1.80T 48.9M /phd-artifacts\n","path":"phd_tests::server_state_machine::instance_reset_test"}
4232024-03-22T05:02:42.585Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.366862654Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-33154a6a-ccf5-447d-ae70-cd9b1964302f\"]","path":"phd_tests::server_state_machine::instance_reset_test"}
4242024-03-22T05:02:42.585Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.380977519Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-33154a6a-ccf5-447d-ae70-cd9b1964302f\", \"phd-artifacts/phd-clone-6d843b50-ea4b-418a-8593-53f593e6e447\"]","verb":"clone","path":"phd_tests::server_state_machine::instance_reset_test"}
4252024-03-22T05:02:42.609Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.399343724Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-6d843b50-ea4b-418a-8593-53f593e6e447\"]","path":"phd_tests::server_state_machine::instance_reset_test"}
4262024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.409669922Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-6d843b50-ea4b-418a-8593-53f593e6e447 0B 1.80T 48.9M /phd-artifacts/phd-clone-6d843b50-ea4b-418a-8593-53f593e6e447\n","path":"phd_tests::server_state_machine::instance_reset_test"}
4272024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.410129046Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test"}
4282024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.410211569Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"instance_reset_returns_to_running_test","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6d843b50-ea4b-418a-8593-53f593e6e447/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::server_state_machine::instance_reset_test"}
4292024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.410275171Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::server_state_machine::instance_reset_test"}
4302024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.410337563Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/instance_reset_returns_to_running_test.config.toml\"","server_addr":"127.0.0.1:9000","path":"phd_tests::server_state_machine::instance_reset_test"}
4312024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.410377684Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/instance_reset_returns_to_running_test.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/instance_reset_returns_to_running_test.stdout.log\"","path":"phd_tests::server_state_machine::instance_reset_test"}
4322024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 897","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.415040917Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::server_state_machine::instance_reset_test"}
4332024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.415294675Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":5}
4342024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.415368768Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4352024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.415409009Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4362024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.415671567Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4372024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.415729359Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4382024-03-22T05:02:43.038Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.416014698Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4392024-03-22T05:02:43.175Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.973439292Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
4402024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.974145054Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: be36bb0b-d810-4595-bfef-7e5c3eb59743, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: f09c0645-369b-4fea-a41b-5ee10ed695fc, silo_id: f13b6d34-193e-4a47-aa27-6d4fdae00c7a }, name: \"phd-vm-be36bb0b-d810-4595-bfef-7e5c3eb59743\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6d843b50-ea4b-418a-8593-53f593e6e447/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4412024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.974233767Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":558,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4422024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.974294069Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4432024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.97432965Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4442024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.974843066Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4452024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.974896517Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4462024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.974938959Z","target":"phd_framework::test_vm","line":598,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4472024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.97497979Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4482024-03-22T05:02:43.202Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.975013581Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4492024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.975525877Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4502024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.975572028Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4512024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.97561375Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4522024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.975646831Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4532024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.976092434Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4542024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.976145596Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4552024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.976179887Z","target":"phd_framework::test_vm","line":598,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4562024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.976215058Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4572024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.976244549Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4582024-03-22T05:02:43.203Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:42.976719944Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4592024-03-22T05:02:43.905Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.703217266Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4602024-03-22T05:02:43.905Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.703271728Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4612024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.703927878Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4622024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.703974059Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":727,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4632024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.70401549Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4642024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.704050211Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4652024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.704513376Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4662024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.704565758Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4672024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.704599708Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4682024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.705035892Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4692024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.705088974Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4702024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.705122264Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4712024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.705552558Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4722024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.70560379Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4732024-03-22T05:02:43.977Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.705636851Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4742024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.706062913Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4752024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.706114845Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4762024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.706147776Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4772024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.70658773Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4782024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.706638501Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4792024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.706671852Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4802024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.707103016Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4812024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.707155717Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4822024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.707189798Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4832024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.707617232Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4842024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.707668293Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4852024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.707701424Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4862024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.708131597Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4872024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.708183189Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4882024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.708217Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4892024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.708641103Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4902024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.708692714Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4912024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.708725715Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4922024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.709157809Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4932024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.709209101Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4942024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.709243322Z","target":"phd_framework::test_vm","line":598,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4952024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.709277703Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4962024-03-22T05:02:43.978Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.709307193Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4972024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.709760547Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4982024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.709804269Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
4992024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.70984289Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5002024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.709876301Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Stop","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5012024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.710305414Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5022024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.710356556Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5032024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.710390587Z","target":"phd_framework::test_vm","line":598,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5042024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.710424668Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5052024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.710453389Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5062024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial websocket closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.710903403Z","target":"phd_framework::serial","line":271,"file":"phd-tests/framework/src/serial/mod.rs"}
5072024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.710995176Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":737}
5082024-03-22T05:02:43.979Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:43.711196312Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5092024-03-22T05:02:44.354Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.15248124Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5102024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.152538152Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5112024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.153596695Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":1,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5122024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.153643186Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":443,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5132024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.153682857Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5142024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.153716988Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5152024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.154361418Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":0,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5162024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.15443258Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5172024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"test phd_tests::server_state_machine::instance_reset_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.154646827Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
5182024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.154731569Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
5192024-03-22T05:02:44.380Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.155147872Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5202024-03-22T05:02:44.484Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.282211895Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5212024-03-22T05:02:44.508Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.282325509Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-6d843b50-ea4b-418a-8593-53f593e6e447\"]","verb":"destroy","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5222024-03-22T05:02:44.534Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.312653733Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5232024-03-22T05:02:44.534Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.312709674Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-33154a6a-ccf5-447d-ae70-cd9b1964302f\"]","verb":"destroy","vm":"instance_reset_returns_to_running_test","path":"phd_tests::server_state_machine::instance_reset_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5242024-03-22T05:02:44.534Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332254036Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":177,"vm":"instance_reset_returns_to_running_test","vm_id":"be36bb0b-d810-4595-bfef-7e5c3eb59743"}
5252024-03-22T05:02:44.534Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332314738Z","target":"phd_tests::server_state_machine","line":52,"file":"phd-tests/tests/src/server_state_machine.rs","path":"phd_tests::server_state_machine::instance_reset_test","elapsed_milliseconds":1975}
5262024-03-22T05:02:44.562Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332485363Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":177}
5272024-03-22T05:02:44.562Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::server_state_machine::instance_stop_causes_destroy_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332556026Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
5282024-03-22T05:02:44.563Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332600807Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
5292024-03-22T05:02:44.563Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332635998Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
5302024-03-22T05:02:44.563Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332752432Z","target":"phd_tests::server_state_machine","line":28,"file":"phd-tests/tests/src/server_state_machine.rs","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5312024-03-22T05:02:44.563Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332833464Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5322024-03-22T05:02:44.563Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.332983219Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5332024-03-22T05:02:44.563Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.33303225Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5342024-03-22T05:02:44.563Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.333078112Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5352024-03-22T05:02:44.563Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.343234405Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.9M 1.80T 48.9M /phd-artifacts\n","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5362024-03-22T05:02:44.564Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.343323577Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-1076f527-16fb-4232-a313-0318ec73b454\"]","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5372024-03-22T05:02:44.564Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.35802443Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-1076f527-16fb-4232-a313-0318ec73b454\", \"phd-artifacts/phd-clone-d71ec86a-baa7-4923-9c47-78f69b1a91ae\"]","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5382024-03-22T05:02:45.118Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.376023174Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-d71ec86a-baa7-4923-9c47-78f69b1a91ae\"]","verb":"list","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5392024-03-22T05:02:45.118Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.386550678Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-d71ec86a-baa7-4923-9c47-78f69b1a91ae 0B 1.80T 48.9M /phd-artifacts/phd-clone-d71ec86a-baa7-4923-9c47-78f69b1a91ae\n","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5402024-03-22T05:02:45.118Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.387055614Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5412024-03-22T05:02:45.118Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.387132926Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","vm_name":"instance_stop_causes_destroy_test","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-d71ec86a-baa7-4923-9c47-78f69b1a91ae/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5422024-03-22T05:02:45.118Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.387198758Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5432024-03-22T05:02:45.118Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.38726533Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/instance_stop_causes_destroy_test.config.toml\"","server_addr":"127.0.0.1:9000","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5442024-03-22T05:02:45.118Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.387304512Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/instance_stop_causes_destroy_test.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/instance_stop_causes_destroy_test.stderr.log\"","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5452024-03-22T05:02:45.119Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 905","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.39210897Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5462024-03-22T05:02:45.119Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.392376048Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":5,"path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5472024-03-22T05:02:45.119Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.39244573Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5482024-03-22T05:02:45.119Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:44.392875913Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5492024-03-22T05:02:45.413Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.211885955Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
5502024-03-22T05:02:45.461Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.212791852Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-d71ec86a-baa7-4923-9c47-78f69b1a91ae/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: c430d1eb-71a3-476a-aae9-e513ee18b996, silo_id: aa7ad559-aff5-41d7-a652-fbfb6138e3e6 }, name: \"phd-vm-c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5\", vcpus: 2 }, state: Creating }","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5512024-03-22T05:02:45.461Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.212883435Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":820,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5522024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.212947127Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5532024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.212983338Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5542024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.213510665Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":0,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5552024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.213564476Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5562024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.213597857Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Stop","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5572024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.214054941Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":0,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5582024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.214109583Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5592024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.214146404Z","target":"phd_framework::test_vm","line":598,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5602024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.214183865Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5612024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.214213026Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5622024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial websocket closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.21467004Z","target":"phd_framework::serial","line":271,"file":"phd-tests/framework/src/serial/mod.rs"}
5632024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.214746152Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":2}
5642024-03-22T05:02:45.462Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.214959359Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":0,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5652024-03-22T05:02:45.940Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.738299195Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5662024-03-22T05:02:45.989Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.738378668Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5672024-03-22T05:02:45.989Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.739144041Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":0,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5682024-03-22T05:02:45.989Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.739189193Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":525,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5692024-03-22T05:02:45.989Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.739229114Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5702024-03-22T05:02:45.989Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.739261825Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5712024-03-22T05:02:45.989Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.739841923Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":0,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5722024-03-22T05:02:45.989Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.739894574Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5732024-03-22T05:02:45.989Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.739927556Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Stop","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5742024-03-22T05:02:45.990Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.74040211Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":0,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5752024-03-22T05:02:45.990Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.740454192Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5762024-03-22T05:02:45.990Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.740487083Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Reboot","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5772024-03-22T05:02:45.990Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.740953897Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":0,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5782024-03-22T05:02:45.990Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.741016769Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5792024-03-22T05:02:45.990Z{"v":0,"name":"phd-runner","msg":"test phd_tests::server_state_machine::instance_stop_causes_destroy_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.741165783Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
5802024-03-22T05:02:45.990Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.741220855Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
5812024-03-22T05:02:45.990Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.741647288Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5822024-03-22T05:02:46.073Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.871062724Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5832024-03-22T05:02:46.099Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.871132626Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-d71ec86a-baa7-4923-9c47-78f69b1a91ae\"]","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5842024-03-22T05:02:46.135Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.902640156Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5852024-03-22T05:02:46.136Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.902696528Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-1076f527-16fb-4232-a313-0318ec73b454\"]","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5862024-03-22T05:02:46.136Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.922694884Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"c862a7d2-1bcf-4c84-843a-f7ff5b0c1ee5","elapsed_milliseconds":181,"vm":"instance_stop_causes_destroy_test","path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5872024-03-22T05:02:46.136Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.922805667Z","target":"phd_tests::server_state_machine","line":28,"file":"phd-tests/tests/src/server_state_machine.rs","elapsed_milliseconds":1590,"path":"phd_tests::server_state_machine::instance_stop_causes_destroy_test"}
5882024-03-22T05:02:46.136Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923022884Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":181}
5892024-03-22T05:02:46.136Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::server_state_machine::instance_start_stop_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923100146Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
5902024-03-22T05:02:46.136Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923142167Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
5912024-03-22T05:02:46.136Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923170738Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
5922024-03-22T05:02:46.137Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923307672Z","target":"phd_tests::server_state_machine","line":12,"file":"phd-tests/tests/src/server_state_machine.rs","path":"phd_tests::server_state_machine::instance_start_stop_test"}
5932024-03-22T05:02:46.137Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923393935Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::server_state_machine::instance_start_stop_test"}
5942024-03-22T05:02:46.170Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923579641Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::server_state_machine::instance_start_stop_test"}
5952024-03-22T05:02:46.170Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923639573Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::server_state_machine::instance_start_stop_test"}
5962024-03-22T05:02:46.170Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.923694244Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::server_state_machine::instance_start_stop_test"}
5972024-03-22T05:02:46.170Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.933514347Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 51.3M 1.80T 48.9M /phd-artifacts\n","path":"phd_tests::server_state_machine::instance_start_stop_test"}
5982024-03-22T05:02:46.170Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.93360414Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-7ca47061-cd8f-47fb-afdd-c226dd9acd5a\"]","verb":"snapshot","path":"phd_tests::server_state_machine::instance_start_stop_test"}
5992024-03-22T05:02:46.170Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.947444076Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-7ca47061-cd8f-47fb-afdd-c226dd9acd5a\", \"phd-artifacts/phd-clone-ea203941-67f6-440d-a9f5-803b2f9be7be\"]","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6002024-03-22T05:02:46.170Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.966217503Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-ea203941-67f6-440d-a9f5-803b2f9be7be\"]","verb":"list","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6012024-03-22T05:02:46.197Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.976997055Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-ea203941-67f6-440d-a9f5-803b2f9be7be 0B 1.80T 48.9M /phd-artifacts/phd-clone-ea203941-67f6-440d-a9f5-803b2f9be7be\n","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6022024-03-22T05:02:46.197Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.977634765Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6032024-03-22T05:02:46.197Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.977775529Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-ea203941-67f6-440d-a9f5-803b2f9be7be/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"instance_ensure_running_test","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6042024-03-22T05:02:46.197Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.977887092Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6052024-03-22T05:02:46.198Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.977951114Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","config_toml_path":"\"/tmp/propolis-phd/instance_ensure_running_test.config.toml\"","server_addr":"127.0.0.1:9000","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6062024-03-22T05:02:46.198Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.977993516Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/instance_ensure_running_test.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/instance_ensure_running_test.stderr.log\"","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6072024-03-22T05:02:46.198Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 913","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.982652229Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6082024-03-22T05:02:46.198Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.982945938Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":5,"path":"phd_tests::server_state_machine::instance_start_stop_test"}
6092024-03-22T05:02:46.198Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.983027271Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6102024-03-22T05:02:46.198Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:45.983518826Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6112024-03-22T05:02:46.812Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.608640167Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
6122024-03-22T05:02:47.472Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.609302587Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-ea203941-67f6-440d-a9f5-803b2f9be7be/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 5fd4850b-753c-4e85-8481-959657450cc0, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 70f4a350-6ad3-463f-825b-7ae61f48271b, silo_id: 758b1738-cf4c-4430-99e7-7b404a9d12b3 }, name: \"phd-vm-5fd4850b-753c-4e85-8481-959657450cc0\", vcpus: 2 }, state: Creating }","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6132024-03-22T05:02:47.472Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.60938759Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":626,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6142024-03-22T05:02:47.472Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.609452881Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6152024-03-22T05:02:47.472Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.609488582Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6162024-03-22T05:02:47.472Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.610010839Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6172024-03-22T05:02:47.473Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.61006649Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6182024-03-22T05:02:47.473Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.610100741Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6192024-03-22T05:02:47.473Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.610598557Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6202024-03-22T05:02:47.473Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.610656978Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6212024-03-22T05:02:47.473Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Running","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.61069939Z","target":"phd_framework::test_vm","line":598,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6222024-03-22T05:02:47.473Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.610748701Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6232024-03-22T05:02:47.474Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.610785702Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6242024-03-22T05:02:47.474Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.611267577Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6252024-03-22T05:02:47.474Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.611313789Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6262024-03-22T05:02:47.474Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.61135478Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6272024-03-22T05:02:47.475Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.611387191Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Stop","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6282024-03-22T05:02:47.475Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.611832105Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6292024-03-22T05:02:47.475Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.611884516Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6302024-03-22T05:02:47.475Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - EVENT] Waiting 60s for server to reach state Destroyed","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.611917227Z","target":"phd_framework::test_vm","line":598,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6312024-03-22T05:02:47.476Z{"v":0,"name":"phd-runner","msg":"[GET - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.611952129Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6322024-03-22T05:02:47.476Z{"v":0,"name":"phd-runner","msg":"[GET - EVENT] Sending instance get request to server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.611980619Z","target":"phd_framework::test_vm","line":449,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6332024-03-22T05:02:47.476Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial websocket closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.616731746Z","target":"phd_framework::serial","line":271,"file":"phd-tests/framework/src/serial/mod.rs"}
6342024-03-22T05:02:47.476Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.61686834Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":8}
6352024-03-22T05:02:47.477Z{"v":0,"name":"phd-runner","msg":"[GET - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.617292173Z","target":"phd_framework::test_vm","line":447,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":5,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6362024-03-22T05:02:47.477Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.617381566Z","target":"phd_framework::test_vm","line":592,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":5,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6372024-03-22T05:02:47.477Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.617481789Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6382024-03-22T05:02:47.477Z{"v":0,"name":"phd-runner","msg":"test phd_tests::server_state_machine::instance_start_stop_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.617772568Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
6392024-03-22T05:02:47.478Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.617870941Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
6402024-03-22T05:02:47.478Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.618305184Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6412024-03-22T05:02:47.478Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.75390201Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6422024-03-22T05:02:47.478Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.753969892Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-ea203941-67f6-440d-a9f5-803b2f9be7be\"]","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6432024-03-22T05:02:47.479Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.783712508Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6442024-03-22T05:02:47.479Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.78376664Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-7ca47061-cd8f-47fb-afdd-c226dd9acd5a\"]","verb":"destroy","vm":"instance_ensure_running_test","vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test"}
6452024-03-22T05:02:47.479Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.799804733Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":182,"vm_id":"5fd4850b-753c-4e85-8481-959657450cc0","path":"phd_tests::server_state_machine::instance_start_stop_test","vm":"instance_ensure_running_test"}
6462024-03-22T05:02:47.480Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.799882846Z","target":"phd_tests::server_state_machine","line":12,"file":"phd-tests/tests/src/server_state_machine.rs","elapsed_milliseconds":876,"path":"phd_tests::server_state_machine::instance_start_stop_test"}
6472024-03-22T05:02:47.480Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.80002641Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":182}
6482024-03-22T05:02:47.480Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::from_base::migration_from_base_and_back","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.800083682Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
6492024-03-22T05:02:47.481Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.800114103Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
6502024-03-22T05:02:47.481Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.800140984Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
6512024-03-22T05:02:47.481Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.800235307Z","target":"phd_tests::migrate::from_base","line":50,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6522024-03-22T05:02:47.481Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.800308989Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6532024-03-22T05:02:47.482Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.800468034Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6542024-03-22T05:02:47.482Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.800516735Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6552024-03-22T05:02:47.482Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.800562747Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","verb":"list","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6562024-03-22T05:02:47.482Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.810188613Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 50.7M 1.80T 48.9M /phd-artifacts\n","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6572024-03-22T05:02:47.483Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.810292806Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-4afb2519-e338-44a8-96b6-ff644aab5391\"]","verb":"snapshot","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6582024-03-22T05:02:47.483Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.824656319Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-4afb2519-e338-44a8-96b6-ff644aab5391\", \"phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de\"]","verb":"clone","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6592024-03-22T05:02:47.483Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.841492787Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de\"]","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6602024-03-22T05:02:47.483Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.852221797Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de 0B 1.80T 48.9M /phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de\n","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6612024-03-22T05:02:47.484Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.852778325Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6622024-03-22T05:02:47.484Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.852887958Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__BASE_PROPOLIS\" }","guest_os_kind":"Alpine","vm_name":"migration_from_base_and_back","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6632024-03-22T05:02:47.484Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] checking for existing copy of artifact","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.85295738Z","target":"phd_framework::artifacts::store","line":89,"file":"phd-tests/framework/src/artifacts/store.rs","maybe_path":"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server.tar.gz","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6642024-03-22T05:02:47.485Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:02:46.853013492Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","timeout":"600s","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/propolis/phd_build/fdf0585c6a227a7cfbee4a61a36938c3d77e4712/propolis-server.tar.gz","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6652024-03-22T05:03:26.119Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Extracting artifact from tarball","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:25.917914228Z","target":"phd_framework::artifacts::store","line":162,"file":"phd-tests/framework/src/artifacts/store.rs","extracted_path":"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server","untar_path":"propolis-server","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6662024-03-22T05:03:26.119Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Extracting gzipped tarball...","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:25.9179822Z","target":"phd_framework::artifacts::store","line":518,"file":"phd-tests/framework/src/artifacts/store.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6672024-03-22T05:03:36.949Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:36.747469457Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server\"","server_addr":"127.0.0.1:9000","config_toml_path":"\"/tmp/propolis-phd/migration_from_base_and_back.config.toml\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6682024-03-22T05:03:36.949Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:36.747543739Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_from_base_and_back.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_from_base_and_back.stdout.log\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6692024-03-22T05:03:36.981Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 921","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:36.779450022Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6702024-03-22T05:03:37.006Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:36.779813963Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","elapsed_milliseconds":49926}
6712024-03-22T05:03:37.006Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:36.779923586Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6722024-03-22T05:03:37.006Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:36.780428112Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6732024-03-22T05:03:37.499Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.298230097Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
6742024-03-22T05:03:37.546Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.299117524Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 769a65fc-37b9-4fce-ae2f-4c4aabd4ae74, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 351f39a2-d919-4c9c-8cde-20829605f588, silo_id: fc9ab875-2419-4df3-8f9e-3a8322ce1fcb }, name: \"phd-vm-769a65fc-37b9-4fce-ae2f-4c4aabd4ae74\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6752024-03-22T05:03:37.546Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.299222657Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":519}
6762024-03-22T05:03:37.546Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.29929909Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6772024-03-22T05:03:37.546Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.299336871Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6782024-03-22T05:03:37.546Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.299897028Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":0}
6792024-03-22T05:03:37.546Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.29994913Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6802024-03-22T05:03:37.547Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.299990121Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"300s","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6812024-03-22T05:03:37.547Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.300023562Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6822024-03-22T05:03:37.547Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.300056223Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6832024-03-22T05:03:37.547Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:37.300089024Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6842024-03-22T05:03:41.687Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.485468149Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":4185}
6852024-03-22T05:03:41.687Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.485551502Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6862024-03-22T05:03:41.712Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.485735258Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6872024-03-22T05:03:41.712Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.48579149Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6882024-03-22T05:03:41.712Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.485832571Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost:~#","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6892024-03-22T05:03:41.712Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.505531117Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":19}
6902024-03-22T05:03:41.712Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.50561401Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
6912024-03-22T05:03:41.712Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.505646141Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","elapsed_milliseconds":4205}
6922024-03-22T05:03:41.712Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.505777505Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6932024-03-22T05:03:41.712Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.505821936Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"ls foo.bar 2> /dev/null","timeout_duration":"Explicit(15s)","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6942024-03-22T05:03:41.737Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.514535325Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":8}
6952024-03-22T05:03:41.737Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.514645548Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6962024-03-22T05:03:41.737Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.514686389Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6972024-03-22T05:03:41.761Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.546288953Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":31}
6982024-03-22T05:03:41.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.546503319Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
6992024-03-22T05:03:41.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.546582002Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"touch ./foo.bar","timeout_duration":"Explicit(15s)","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7002024-03-22T05:03:41.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.55790996Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":11}
7012024-03-22T05:03:41.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.558129337Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7022024-03-22T05:03:41.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.55821755Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7032024-03-22T05:03:41.786Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.579675971Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":21}
7042024-03-22T05:03:41.787Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.579807805Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7052024-03-22T05:03:41.787Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.579855396Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sync ./foo.bar","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7062024-03-22T05:03:41.811Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.590199465Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":10}
7072024-03-22T05:03:41.812Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.590448882Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7082024-03-22T05:03:41.812Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.590535185Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7092024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.612886233Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":22}
7102024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.612995367Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","propolis_artifact":"__DEFAULT_PROPOLIS","vm_name":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7112024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.613062409Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7122024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.613135171Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7132024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.613212934Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7142024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.613298336Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.config.toml\"","server_addr":"127.0.0.1:9002","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7152024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.613346607Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stderr.log\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7162024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 922","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.628008519Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7172024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.628606457Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","elapsed_milliseconds":15}
7182024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.628756292Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7192024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.628885656Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"1ba01aee-b47b-4ae1-bf48-e3336e7e5c17","timeout_duration":"45s","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7202024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.6290026Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","vm":"migration_from_base_and_back_lifecycle_0"}
7212024-03-22T05:03:41.860Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:41.629509905Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","vm":"migration_from_base_and_back_lifecycle_0"}
7222024-03-22T05:03:42.601Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:42.399448485Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 5fc0f606-0f6a-4943-bfa9-666a6d04eb39, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: ef1089a7-1fd1-459c-9235-93d55b1312ed, silo_id: 1355e4f3-3603-4bb3-8110-31e48d7a017b }, name: \"phd-vm-5fc0f606-0f6a-4943-bfa9-666a6d04eb39\", vcpus: 2 }, state: Migrating }","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","vm":"migration_from_base_and_back_lifecycle_0"}
7232024-03-22T05:03:42.626Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:42.399577759Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","vm":"migration_from_base_and_back_lifecycle_0","elapsed_milliseconds":770,"source":"migration_from_base_and_back","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7242024-03-22T05:03:42.626Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:42.399648441Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","migration_id":"1ba01aee-b47b-4ae1-bf48-e3336e7e5c17"}
7252024-03-22T05:03:54.098Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:53.891530896Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9002\",\"from_start\":7718}}"}
7262024-03-22T05:03:54.603Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.40277928Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7272024-03-22T05:03:54.628Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.402890173Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":12003,"target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","migration_id":"1ba01aee-b47b-4ae1-bf48-e3336e7e5c17"}
7282024-03-22T05:03:54.628Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.402991096Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back","source_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","target_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","elapsed_milliseconds":12774}
7292024-03-22T05:03:54.628Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.404163443Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7302024-03-22T05:03:54.629Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.404342898Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7312024-03-22T05:03:54.629Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.40440311Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"ls foo.bar","timeout_duration":"Explicit(15s)","vm":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7322024-03-22T05:03:54.629Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.405030399Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74"}
7332024-03-22T05:03:54.742Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.541646866Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back","vm_id":"769a65fc-37b9-4fce-ae2f-4c4aabd4ae74","elapsed_milliseconds":137}
7342024-03-22T05:03:54.768Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.541917445Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_0","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","elapsed_milliseconds":137}
7352024-03-22T05:03:54.768Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.54207888Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7362024-03-22T05:03:54.769Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.542129081Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7372024-03-22T05:03:54.769Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.564679306Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_0","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","elapsed_milliseconds":22}
7382024-03-22T05:03:54.769Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.564760128Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","vm_name":"migration_from_base_and_back","propolis_artifact":"__BASE_PROPOLIS","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7392024-03-22T05:03:54.769Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.56482969Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7402024-03-22T05:03:54.769Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.564901882Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__BASE_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","vm_name":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7412024-03-22T05:03:54.769Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.564974115Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7422024-03-22T05:03:54.769Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.565050067Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9004","server_path":"\"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.config.toml\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7432024-03-22T05:03:54.769Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.565094908Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.stdout.log\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7442024-03-22T05:03:54.795Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 924","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.580434461Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7452024-03-22T05:03:54.795Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.580803982Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","elapsed_milliseconds":15}
7462024-03-22T05:03:54.795Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.580897515Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7472024-03-22T05:03:54.795Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9002","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.580949457Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"45s","migration_id":"318d35ec-c1ce-4b71-b050-96d981674a08","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7482024-03-22T05:03:54.795Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.581014339Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"fd819565-8a65-4604-9496-81cf692f9823","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823","vm":"migration_from_base_and_back_lifecycle_1"}
7492024-03-22T05:03:54.795Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:54.581561015Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9004/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"fd819565-8a65-4604-9496-81cf692f9823","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823","vm":"migration_from_base_and_back_lifecycle_1"}
7502024-03-22T05:03:55.318Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:55.116679174Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: fd819565-8a65-4604-9496-81cf692f9823, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 81796421-e034-4d31-b7bd-c79aec5eb8d3, silo_id: 81f4c7b0-ab7a-440e-a670-1e8e6d432f72 }, name: \"phd-vm-fd819565-8a65-4604-9496-81cf692f9823\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_id":"fd819565-8a65-4604-9496-81cf692f9823","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823","vm":"migration_from_base_and_back_lifecycle_1"}
7512024-03-22T05:03:55.344Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:55.116802388Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fd819565-8a65-4604-9496-81cf692f9823","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","vm":"migration_from_base_and_back_lifecycle_1","elapsed_milliseconds":535,"source":"migration_from_base_and_back_lifecycle_0","target_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7522024-03-22T05:03:55.344Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:03:55.11686371Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823","migration_id":"318d35ec-c1ce-4b71-b050-96d981674a08"}
7532024-03-22T05:04:06.908Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:06.695235445Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9004\",\"from_start\":7765}}"}
7542024-03-22T05:04:09.296Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.095353985Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7552024-03-22T05:04:09.296Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.095409036Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":13978,"target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823","migration_id":"318d35ec-c1ce-4b71-b050-96d981674a08"}
7562024-03-22T05:04:09.321Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.095454828Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_0","source_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","target_id":"fd819565-8a65-4604-9496-81cf692f9823","elapsed_milliseconds":14514}
7572024-03-22T05:04:09.321Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.096861361Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7582024-03-22T05:04:09.321Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.097081428Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7592024-03-22T05:04:09.321Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.09713316Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"ls foo.bar","vm":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7602024-03-22T05:04:09.322Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.097502931Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39"}
7612024-03-22T05:04:09.428Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.224147141Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_0","vm_id":"5fc0f606-0f6a-4943-bfa9-666a6d04eb39","elapsed_milliseconds":127}
7622024-03-22T05:04:09.454Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.224371718Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_1","vm_id":"fd819565-8a65-4604-9496-81cf692f9823","elapsed_milliseconds":127}
7632024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.224557204Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7642024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.224611425Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7652024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.24718913Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_1","vm_id":"fd819565-8a65-4604-9496-81cf692f9823","elapsed_milliseconds":22}
7662024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.247249923Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","propolis_artifact":"__DEFAULT_PROPOLIS","vm_name":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7672024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.247303624Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7682024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.247367896Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_name":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7692024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.247440968Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7702024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.247512271Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","config_toml_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9006","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7712024-03-22T05:04:09.455Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.247552592Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.stderr.log\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7722024-03-22T05:04:09.481Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 926","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.263807872Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
7732024-03-22T05:04:09.482Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.264124392Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","elapsed_milliseconds":16}
7742024-03-22T05:04:09.482Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.264217065Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7752024-03-22T05:04:09.482Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9004","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.264262876Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"45s","migration_id":"780c4619-788b-4539-ba24-e5dbf85fd0fb","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7762024-03-22T05:04:09.482Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.264317298Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","vm":"migration_from_base_and_back_lifecycle_2"}
7772024-03-22T05:04:09.482Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.26468802Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9006/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","vm":"migration_from_base_and_back_lifecycle_2"}
7782024-03-22T05:04:10.182Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.980256104Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: e74475f6-4902-43ae-a0df-d57c859c4d5d, silo_id: e999dc67-b633-4012-9749-d915c9ce37d7 }, name: \"phd-vm-fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","vm":"migration_from_base_and_back_lifecycle_2"}
7792024-03-22T05:04:10.207Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.980365678Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","source_id":"fd819565-8a65-4604-9496-81cf692f9823","vm":"migration_from_base_and_back_lifecycle_2","elapsed_milliseconds":716,"source":"migration_from_base_and_back_lifecycle_1","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7802024-03-22T05:04:10.207Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:09.98041638Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","migration_id":"780c4619-788b-4539-ba24-e5dbf85fd0fb"}
7812024-03-22T05:04:21.737Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:21.528564315Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9006\",\"from_start\":7812}}"}
7822024-03-22T05:04:29.096Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:28.895089042Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7832024-03-22T05:04:29.096Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:28.895153844Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":18914,"target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","migration_id":"780c4619-788b-4539-ba24-e5dbf85fd0fb"}
7842024-03-22T05:04:29.122Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:28.895200345Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","source":"migration_from_base_and_back_lifecycle_1","source_id":"fd819565-8a65-4604-9496-81cf692f9823","target_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","elapsed_milliseconds":19630}
7852024-03-22T05:04:29.122Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:28.896572417Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7862024-03-22T05:04:29.123Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:28.896791034Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7872024-03-22T05:04:29.123Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:28.896842686Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"ls foo.bar","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7882024-03-22T05:04:29.123Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:28.897387733Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9004","vm":"migration_from_base_and_back_lifecycle_1","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fd819565-8a65-4604-9496-81cf692f9823"}
7892024-03-22T05:04:29.225Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.024890369Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_1","vm_id":"fd819565-8a65-4604-9496-81cf692f9823","elapsed_milliseconds":128}
7902024-03-22T05:04:29.254Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.025149707Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_2","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","elapsed_milliseconds":128}
7912024-03-22T05:04:29.255Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.025324402Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7922024-03-22T05:04:29.255Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.025382964Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7932024-03-22T05:04:29.291Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.059095382Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_2","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","elapsed_milliseconds":33}
7942024-03-22T05:04:29.291Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.059277328Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
7952024-03-22T05:04:29.291Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.059518895Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
7962024-03-22T05:04:29.292Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::from_base::migration_from_base_and_back ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.059568617Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
7972024-03-22T05:04:29.292Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.05966893Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":51761}
7982024-03-22T05:04:29.292Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.0596782Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
7992024-03-22T05:04:29.292Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.060282349Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
8002024-03-22T05:04:29.996Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.79453649Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9006","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
8012024-03-22T05:04:30.132Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.931042144Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
8022024-03-22T05:04:30.157Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.931134507Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-6187cbdf-7188-41e5-a66e-7b5d3673e0de\"]","verb":"destroy","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
8032024-03-22T05:04:30.182Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.965371861Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
8042024-03-22T05:04:30.182Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.965427423Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-4afb2519-e338-44a8-96b6-ff644aab5391\"]","verb":"destroy","vm":"migration_from_base_and_back_lifecycle_2","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2"}
8052024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991069611Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","vm":"migration_from_base_and_back_lifecycle_2","vm_id":"fa1ab7f9-faf7-44c8-8550-bbe6e64b0ed2","elapsed_milliseconds":931}
8062024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991154994Z","target":"phd_tests::migrate::from_base","line":50,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back","elapsed_milliseconds":103190}
8072024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.99133879Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":931}
8082024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::from_base::serial_history","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991398371Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
8092024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991426352Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
8102024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991454363Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
8112024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991564517Z","target":"phd_tests::migrate::from_base","line":38,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::serial_history"}
8122024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991640439Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::from_base::serial_history"}
8132024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991797634Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::serial_history"}
8142024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991844715Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::serial_history"}
8152024-03-22T05:04:30.209Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:29.991895097Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::from_base::serial_history"}
8162024-03-22T05:04:30.235Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.009466148Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 650M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::from_base::serial_history"}
8172024-03-22T05:04:30.235Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.00954367Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-bc29e704-67fa-451c-875b-c40041c9d2d4\"]","verb":"snapshot","path":"phd_tests::migrate::from_base::serial_history"}
8182024-03-22T05:04:30.236Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.029476844Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-bc29e704-67fa-451c-875b-c40041c9d2d4\", \"phd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d\"]","path":"phd_tests::migrate::from_base::serial_history"}
8192024-03-22T05:04:30.261Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.052876105Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d\"]","path":"phd_tests::migrate::from_base::serial_history"}
8202024-03-22T05:04:30.287Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.066871306Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d 0B 1.80T 649M /phd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d\n","path":"phd_tests::migrate::from_base::serial_history"}
8212024-03-22T05:04:30.287Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.067377911Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history"}
8222024-03-22T05:04:30.287Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.067461074Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","vm_name":"migration_serial_history_base","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__BASE_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::migrate::from_base::serial_history"}
8232024-03-22T05:04:30.287Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.067528986Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server","path":"phd_tests::migrate::from_base::serial_history"}
8242024-03-22T05:04:30.288Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.067604048Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migration_serial_history_base.config.toml\"","server_addr":"127.0.0.1:9000","path":"phd_tests::migrate::from_base::serial_history"}
8252024-03-22T05:04:30.288Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.06764439Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_serial_history_base.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_serial_history_base.stdout.log\"","path":"phd_tests::migrate::from_base::serial_history"}
8262024-03-22T05:04:30.288Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 935","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.07675908Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::serial_history"}
8272024-03-22T05:04:30.288Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.07707104Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":9}
8282024-03-22T05:04:30.288Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.077153452Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8292024-03-22T05:04:30.288Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.077622477Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8302024-03-22T05:04:30.988Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.786876798Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
8312024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.787692263Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 1810bbc3-8628-41ff-95e2-267b57f6e13b, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: a58b917a-afec-4bdb-ad97-b51e8a361a8a, silo_id: 1b51ec06-5453-4b18-81ef-972a8a2bf7a1 }, name: \"phd-vm-1810bbc3-8628-41ff-95e2-267b57f6e13b\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8322024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.787795127Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":710,"vm":"migration_serial_history_base","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history"}
8332024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.787857108Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8342024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.787892099Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8352024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.788454467Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm":"migration_serial_history_base","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history"}
8362024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.788508018Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history"}
8372024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.788551Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"300s","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","vm":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history"}
8382024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.788586351Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::from_base::serial_history"}
8392024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.788618802Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8402024-03-22T05:04:31.036Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:30.788653823Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8412024-03-22T05:04:35.183Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:34.981695665Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4193,"vm":"migration_serial_history_base","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history"}
8422024-03-22T05:04:35.183Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:34.981763367Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::from_base::serial_history"}
8432024-03-22T05:04:35.209Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:34.981931262Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::serial_history"}
8442024-03-22T05:04:35.209Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:34.981979273Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8452024-03-22T05:04:35.209Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:34.982023745Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost:~#","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8462024-03-22T05:04:35.209Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.001172224Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":19,"vm":"migration_serial_history_base","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history"}
8472024-03-22T05:04:35.209Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.001243517Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history"}
8482024-03-22T05:04:35.209Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.001273948Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":4212}
8492024-03-22T05:04:35.209Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.001404432Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8502024-03-22T05:04:35.209Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.001447013Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"echo hello from the source VM!","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8512024-03-22T05:04:35.235Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.0110983Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":9,"vm":"migration_serial_history_base","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history"}
8522024-03-22T05:04:35.235Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.011208753Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8532024-03-22T05:04:35.235Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.011249105Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8542024-03-22T05:04:35.261Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.042854188Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":31,"vm":"migration_serial_history_base","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history"}
8552024-03-22T05:04:35.261Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.046615094Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","vm_name":"migration_serial_history_base","propolis_artifact":"__DEFAULT_PROPOLIS","path":"phd_tests::migrate::from_base::serial_history"}
8562024-03-22T05:04:35.261Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.046674926Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history"}
8572024-03-22T05:04:35.261Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.046739988Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"migration_serial_history_base_lifecycle_0","path":"phd_tests::migrate::from_base::serial_history"}
8582024-03-22T05:04:35.262Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.04681302Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::from_base::serial_history"}
8592024-03-22T05:04:35.262Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.046885072Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migration_serial_history_base_lifecycle_0.config.toml\"","server_addr":"127.0.0.1:9002","path":"phd_tests::migrate::from_base::serial_history"}
8602024-03-22T05:04:35.262Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.046924273Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stderr.log\"","path":"phd_tests::migrate::from_base::serial_history"}
8612024-03-22T05:04:35.287Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 936","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.060745479Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::serial_history"}
8622024-03-22T05:04:35.287Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.06110149Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":14}
8632024-03-22T05:04:35.287Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.061194013Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history"}
8642024-03-22T05:04:35.287Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.061246645Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"da15f9ad-52d4-479c-870b-915d577b9870","timeout_duration":"45s","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history"}
8652024-03-22T05:04:35.287Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.061310267Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"73b56987-595d-40a7-814d-938fbae54780","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8662024-03-22T05:04:35.287Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.061671747Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"73b56987-595d-40a7-814d-938fbae54780","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8672024-03-22T05:04:36.054Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.847320712Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 73b56987-595d-40a7-814d-938fbae54780, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 6c4edd48-35c4-4974-91ab-fef46a30aa1f, silo_id: 5f2f1eaf-1d44-4046-a3a3-1a91e064dca8 }, name: \"phd-vm-73b56987-595d-40a7-814d-938fbae54780\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_id":"73b56987-595d-40a7-814d-938fbae54780","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8682024-03-22T05:04:36.086Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.847441665Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","elapsed_milliseconds":786,"source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","vm":"migration_serial_history_base_lifecycle_0","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history"}
8692024-03-22T05:04:36.086Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:35.847507217Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"da15f9ad-52d4-479c-870b-915d577b9870","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history"}
8702024-03-22T05:04:47.487Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.284555202Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9002\",\"from_start\":7685}}"}
8712024-03-22T05:04:47.515Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.304464615Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history"}
8722024-03-22T05:04:47.515Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.304512547Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"da15f9ad-52d4-479c-870b-915d577b9870","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":11456}
8732024-03-22T05:04:47.515Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.304555058Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","target":"migration_serial_history_base_lifecycle_0","target_id":"73b56987-595d-40a7-814d-938fbae54780","source":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":12243}
8742024-03-22T05:04:47.544Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.331965633Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8752024-03-22T05:04:47.544Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.332819799Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8762024-03-22T05:04:47.544Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] error stopping VM to move it to Destroyed","level":50,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.333584152Z","target":"phd_framework::test_vm","line":981,"file":"phd-tests/framework/src/test_vm/mod.rs","error":"Error Response: status: 404 Not Found; headers: {\"content-type\": \"application/json\", \"x-request-id\": \"bbd5e021-0145-43e1-9472-f81347b7f30d\", \"content-length\": \"84\", \"date\": \"Fri, 22 Mar 2024 05:04:47 GMT\"}; value: Error { error_code: None, message: \"Not Found\", request_id: \"bbd5e021-0145-43e1-9472-f81347b7f30d\" }","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8772024-03-22T05:04:47.544Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.333638204Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base"}
8782024-03-22T05:04:47.569Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.347543042Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8792024-03-22T05:04:47.569Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.347852882Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
8802024-03-22T05:04:47.569Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.347995346Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":16561}
8812024-03-22T05:04:47.569Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::from_base::serial_history ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.347981926Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
8822024-03-22T05:04:47.569Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.348100929Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
8832024-03-22T05:04:47.569Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.348658487Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8842024-03-22T05:04:47.666Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.453540306Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":121,"vm":"migration_serial_history_base","vm_id":"1810bbc3-8628-41ff-95e2-267b57f6e13b","path":"phd_tests::migrate::from_base::serial_history"}
8852024-03-22T05:04:48.183Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:47.982273648Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8862024-03-22T05:04:48.319Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.118481962Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8872024-03-22T05:04:48.344Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.118572675Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-2502c025-55a6-4305-a9a1-a3fce24e368d\"]","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8882024-03-22T05:04:48.373Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.152568842Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8892024-03-22T05:04:48.373Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.152619024Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-bc29e704-67fa-451c-875b-c40041c9d2d4\"]","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0"}
8902024-03-22T05:04:48.424Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.176587532Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":828,"vm":"migration_serial_history_base_lifecycle_0","vm_id":"73b56987-595d-40a7-814d-938fbae54780","path":"phd_tests::migrate::from_base::serial_history"}
8912024-03-22T05:04:48.424Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.176654944Z","target":"phd_tests::migrate::from_base","line":38,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":18185}
8922024-03-22T05:04:48.424Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.17687892Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":828}
8932024-03-22T05:04:48.424Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::from_base::can_migrate_from_base","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.176960913Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
8942024-03-22T05:04:48.424Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.176994474Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
8952024-03-22T05:04:48.424Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.177023185Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
8962024-03-22T05:04:48.424Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.177146639Z","target":"phd_tests::migrate::from_base","line":32,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
8972024-03-22T05:04:48.425Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.177231422Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
8982024-03-22T05:04:48.425Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.177398767Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
8992024-03-22T05:04:48.425Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.177449418Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9002024-03-22T05:04:48.425Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.17750312Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","verb":"list","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9012024-03-22T05:04:48.453Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.198796366Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 650M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9022024-03-22T05:04:48.453Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.198873028Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-cca49af9-6589-4e5c-a392-06fb5b8ca9fd\"]","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9032024-03-22T05:04:48.453Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.224788786Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-cca49af9-6589-4e5c-a392-06fb5b8ca9fd\", \"phd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7\"]","verb":"clone","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9042024-03-22T05:04:48.453Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.246535836Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7\"]","verb":"list","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9052024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.262335112Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7 0B 1.80T 649M /phd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7\n","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9062024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.262956861Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9072024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.263039604Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__BASE_PROPOLIS\" }","vm_name":"migration_from_base","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9082024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.263110796Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9092024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.263186128Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/phd-artifacts/7bfa4fe7fc4f245e985b35c62ff6ea6f26396a61795e296edc46520c3c7b7695/propolis-server\"","server_addr":"127.0.0.1:9000","config_toml_path":"\"/tmp/propolis-phd/migration_from_base.config.toml\"","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9102024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.26324283Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_from_base.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_from_base.stderr.log\"","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9112024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 945","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.271818284Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9122024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.272186215Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":9,"path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9132024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.272279189Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9142024-03-22T05:04:48.484Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.272794874Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9152024-03-22T05:04:48.936Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.73472703Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
9162024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.735281196Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 9a9582a1-af25-476f-b2ce-1b250e6e48eb, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 9329f23e-dba4-4f84-aa81-56f98cb0129a, silo_id: 56c36c6a-32cd-4a9c-a7b8-179a737ce0ff }, name: \"phd-vm-9a9582a1-af25-476f-b2ce-1b250e6e48eb\", vcpus: 2 }, state: Creating }","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9172024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.73538247Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":463,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9182024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.735464382Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9192024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.735517264Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9202024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.736081481Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":0,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9212024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.736136313Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9222024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.736180334Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"300s","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","vm":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9232024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.736215915Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9242024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.736250966Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9252024-03-22T05:04:48.961Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:48.736285278Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9262024-03-22T05:04:53.180Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.979219105Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":4242,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9272024-03-22T05:04:53.214Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.979300408Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9282024-03-22T05:04:53.214Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.979467513Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9292024-03-22T05:04:53.214Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.979518105Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9302024-03-22T05:04:53.214Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.979554926Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost:~#","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9312024-03-22T05:04:53.214Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.998966693Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":19,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9322024-03-22T05:04:53.214Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.999025205Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9332024-03-22T05:04:53.215Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.999056006Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4262,"path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9342024-03-22T05:04:53.215Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.999213091Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9352024-03-22T05:04:53.215Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:52.999257462Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"ls foo.bar 2> /dev/null","timeout_duration":"Explicit(15s)","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9362024-03-22T05:04:53.240Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.00925221Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":9,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9372024-03-22T05:04:53.240Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.009366664Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9382024-03-22T05:04:53.241Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.009407555Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9392024-03-22T05:04:53.266Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.041027689Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":31,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9402024-03-22T05:04:53.266Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.041292217Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9412024-03-22T05:04:53.266Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.04139023Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"touch ./foo.bar","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9422024-03-22T05:04:53.266Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.052700918Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":11,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9432024-03-22T05:04:53.266Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.052916205Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9442024-03-22T05:04:53.266Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.052979937Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9452024-03-22T05:04:53.291Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.085476298Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":32,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9462024-03-22T05:04:53.291Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.085715165Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9472024-03-22T05:04:53.291Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.085799668Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"sync ./foo.bar","timeout_duration":"Explicit(15s)","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9482024-03-22T05:04:53.317Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.096151776Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":10,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9492024-03-22T05:04:53.317Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.096409634Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9502024-03-22T05:04:53.317Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.096491267Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9512024-03-22T05:04:53.343Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.118891667Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":22,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9522024-03-22T05:04:53.343Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.118966909Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","vm_name":"migration_from_base","propolis_artifact":"__DEFAULT_PROPOLIS","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9532024-03-22T05:04:53.343Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.119032261Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9542024-03-22T05:04:53.343Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.119119164Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"migration_from_base_lifecycle_0","guest_os_kind":"Alpine","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9552024-03-22T05:04:53.343Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.119194766Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9562024-03-22T05:04:53.343Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.119278378Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migration_from_base_lifecycle_0.config.toml\"","server_addr":"127.0.0.1:9002","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9572024-03-22T05:04:53.343Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.11932314Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_from_base_lifecycle_0.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_from_base_lifecycle_0.stderr.log\"","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9582024-03-22T05:04:53.343Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 946","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.133889448Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9592024-03-22T05:04:53.344Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.13426579Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":15,"path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9602024-03-22T05:04:53.344Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.134354963Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","target":"migration_from_base_lifecycle_0"}
9612024-03-22T05:04:53.344Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.134397994Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"45s","migration_id":"f5dcdb4a-b130-41c7-8b6e-473635a5a9fc","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","target":"migration_from_base_lifecycle_0"}
9622024-03-22T05:04:53.344Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.134455886Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","vm":"migration_from_base_lifecycle_0","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","target":"migration_from_base_lifecycle_0"}
9632024-03-22T05:04:53.344Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.134934721Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","vm":"migration_from_base_lifecycle_0","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","target":"migration_from_base_lifecycle_0"}
9642024-03-22T05:04:54.200Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.999189125Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 883f9f99-7331-4ce0-bdbf-3b924590e8b5, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: ace47b7d-ebde-4d83-935b-a38a3effff36, silo_id: ece9de50-e27f-4ac9-963d-df69ea248c3d }, name: \"phd-vm-883f9f99-7331-4ce0-bdbf-3b924590e8b5\", vcpus: 2 }, state: Migrating }","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","vm":"migration_from_base_lifecycle_0","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","target":"migration_from_base_lifecycle_0"}
9652024-03-22T05:04:54.225Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.999319149Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":864,"vm":"migration_from_base_lifecycle_0","target":"migration_from_base_lifecycle_0"}
9662024-03-22T05:04:54.225Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:04:53.999393761Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","target":"migration_from_base_lifecycle_0","migration_id":"f5dcdb4a-b130-41c7-8b6e-473635a5a9fc"}
9672024-03-22T05:05:05.682Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:05.481232775Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9002\",\"from_start\":7718}}"}
9682024-03-22T05:05:09.576Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.370564504Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","target":"migration_from_base_lifecycle_0"}
9692024-03-22T05:05:09.602Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.370672797Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":15371,"target":"migration_from_base_lifecycle_0","migration_id":"f5dcdb4a-b130-41c7-8b6e-473635a5a9fc"}
9702024-03-22T05:05:09.602Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.37077153Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":16236,"target":"migration_from_base_lifecycle_0"}
9712024-03-22T05:05:09.602Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.372617967Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9722024-03-22T05:05:09.602Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.372840634Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9732024-03-22T05:05:09.602Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.372891026Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"ls foo.bar","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9742024-03-22T05:05:09.602Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.373292698Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9752024-03-22T05:05:09.699Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.498418311Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"9a9582a1-af25-476f-b2ce-1b250e6e48eb","elapsed_milliseconds":125,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base"}
9762024-03-22T05:05:09.725Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.498767012Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","elapsed_milliseconds":125,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9772024-03-22T05:05:09.725Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.498962788Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9782024-03-22T05:05:09.726Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.49901647Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9792024-03-22T05:05:09.726Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.521599035Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","elapsed_milliseconds":22,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9802024-03-22T05:05:09.726Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.521696818Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9812024-03-22T05:05:09.726Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.521855393Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
9822024-03-22T05:05:09.726Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::from_base::can_migrate_from_base ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.521919815Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
9832024-03-22T05:05:09.726Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.521947556Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":20787}
9842024-03-22T05:05:09.726Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.522050289Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
9852024-03-22T05:05:09.726Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:09.522802022Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9862024-03-22T05:05:10.406Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.204858095Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9872024-03-22T05:05:10.541Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.340207053Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9882024-03-22T05:05:10.567Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.340314076Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-275f451f-7741-4b71-84a9-faafe6d966d7\"]","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9892024-03-22T05:05:10.592Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.372559449Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9902024-03-22T05:05:10.592Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.372621291Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-cca49af9-6589-4e5c-a392-06fb5b8ca9fd\"]","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9912024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.399388685Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"883f9f99-7331-4ce0-bdbf-3b924590e8b5","elapsed_milliseconds":877,"path":"phd_tests::migrate::from_base::can_migrate_from_base","vm":"migration_from_base_lifecycle_0"}
9922024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.399456538Z","target":"phd_tests::migrate::from_base","line":32,"file":"phd-tests/tests/src/migrate.rs","elapsed_milliseconds":22222,"path":"phd_tests::migrate::from_base::can_migrate_from_base"}
9932024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.399657354Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":877}
9942024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::multiple_migrations","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.399724786Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
9952024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.399754487Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
9962024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.399780668Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
9972024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.3998762Z","target":"phd_tests::migrate","line":291,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::multiple_migrations"}
9982024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.399970623Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::multiple_migrations"}
9992024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.400126058Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::multiple_migrations"}
10002024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.40017912Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::multiple_migrations"}
10012024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.400223691Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::multiple_migrations"}
10022024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.415206773Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 651M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::multiple_migrations"}
10032024-03-22T05:05:10.619Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.415299855Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-ce8ca069-1208-449d-b97f-e6dd907d3917\"]","verb":"snapshot","path":"phd_tests::migrate::multiple_migrations"}
10042024-03-22T05:05:10.645Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.432752833Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-ce8ca069-1208-449d-b97f-e6dd907d3917\", \"phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061\"]","path":"phd_tests::migrate::multiple_migrations"}
10052024-03-22T05:05:10.670Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.455656268Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061\"]","verb":"list","path":"phd_tests::migrate::multiple_migrations"}
10062024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.471682772Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061 0B 1.80T 649M /phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061\n","path":"phd_tests::migrate::multiple_migrations"}
10072024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.472235359Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations"}
10082024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.472322251Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"multiple_migrations_0","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::migrate::multiple_migrations"}
10092024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.472395824Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::multiple_migrations"}
10102024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.472472566Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9000","config_toml_path":"\"/tmp/propolis-phd/multiple_migrations_0.config.toml\"","path":"phd_tests::migrate::multiple_migrations"}
10112024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.472512957Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/multiple_migrations_0.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/multiple_migrations_0.stdout.log\"","path":"phd_tests::migrate::multiple_migrations"}
10122024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 955","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.482476744Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::multiple_migrations"}
10132024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.482920818Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","elapsed_milliseconds":10}
10142024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.483003031Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations"}
10152024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.483071382Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"multiple_migrations_1","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::migrate::multiple_migrations"}
10162024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.483134275Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::multiple_migrations"}
10172024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.483198317Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9002","config_toml_path":"\"/tmp/propolis-phd/multiple_migrations_1.config.toml\"","path":"phd_tests::migrate::multiple_migrations"}
10182024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.483235888Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/multiple_migrations_1.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/multiple_migrations_1.stderr.log\"","path":"phd_tests::migrate::multiple_migrations"}
10192024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 956","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.493148683Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::multiple_migrations"}
10202024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.493485973Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","elapsed_milliseconds":10}
10212024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.493566276Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations"}
10222024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.493647028Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","vm_name":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations"}
10232024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.493724061Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::multiple_migrations"}
10242024-03-22T05:05:10.700Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.493786923Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9004","config_toml_path":"\"/tmp/propolis-phd/multiple_migrations_2.config.toml\"","path":"phd_tests::migrate::multiple_migrations"}
10252024-03-22T05:05:10.701Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.493824094Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/multiple_migrations_2.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/multiple_migrations_2.stdout.log\"","path":"phd_tests::migrate::multiple_migrations"}
10262024-03-22T05:05:10.727Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 957","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.503884943Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::multiple_migrations"}
10272024-03-22T05:05:10.727Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.504251075Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","elapsed_milliseconds":10}
10282024-03-22T05:05:10.727Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.504337908Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10292024-03-22T05:05:10.823Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.622666501Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
10302024-03-22T05:05:10.861Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.623496927Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: afa7da7a-2f28-4970-90ff-96bac2b81012, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 1d826d0d-fc96-4b51-a53f-7a4c2827f596, silo_id: 2ceb6f04-f13f-4db9-92a8-67919d21b871 }, name: \"phd-vm-afa7da7a-2f28-4970-90ff-96bac2b81012\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10312024-03-22T05:05:10.861Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.62360642Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012","elapsed_milliseconds":119,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0"}
10322024-03-22T05:05:10.861Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.623688723Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10332024-03-22T05:05:10.861Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.623731594Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10342024-03-22T05:05:10.862Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.624306972Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012","elapsed_milliseconds":0,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0"}
10352024-03-22T05:05:10.862Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.624363544Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations"}
10362024-03-22T05:05:10.862Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.624404785Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012","timeout_duration":"300s","vm":"multiple_migrations_0","path":"phd_tests::migrate::multiple_migrations"}
10372024-03-22T05:05:10.862Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.624438336Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::multiple_migrations"}
10382024-03-22T05:05:10.862Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.624472287Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10392024-03-22T05:05:10.862Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:10.624504408Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10402024-03-22T05:05:15.070Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.869694895Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012","elapsed_milliseconds":4245,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0"}
10412024-03-22T05:05:15.070Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.869762267Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::multiple_migrations"}
10422024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.869932652Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::multiple_migrations"}
10432024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.869979393Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10442024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.870013365Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10452024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.890186636Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012","elapsed_milliseconds":20,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0"}
10462024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.890256708Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations"}
10472024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.890286639Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","elapsed_milliseconds":4265}
10482024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.890344341Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10492024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.890386992Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"92d4948e-69a7-4bc3-8202-6ecfa56c7504","timeout_duration":"45s","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10502024-03-22T05:05:15.097Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:14.890431263Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1","source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10512024-03-22T05:05:15.216Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:15.01536927Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 1a3b1cf6-96ec-4ce8-9d5e-0849db71a352, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 08252c0b-5537-4ec7-b9ae-adfd207a7cb6, silo_id: 2382db3a-0e56-4826-9a16-1b3887820b89 }, name: \"phd-vm-1a3b1cf6-96ec-4ce8-9d5e-0849db71a352\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1","source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10522024-03-22T05:05:15.242Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:15.015487893Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012","elapsed_milliseconds":125,"vm":"multiple_migrations_1","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10532024-03-22T05:05:15.242Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:15.015544145Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","migration_id":"92d4948e-69a7-4bc3-8202-6ecfa56c7504","source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10542024-03-22T05:05:26.738Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:26.53729512Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9002\",\"from_start\":7609}}"}
10552024-03-22T05:05:29.824Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.621521497Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10562024-03-22T05:05:29.824Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.621586529Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","migration_id":"92d4948e-69a7-4bc3-8202-6ecfa56c7504","source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","elapsed_milliseconds":14606,"source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10572024-03-22T05:05:29.866Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.62163324Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","elapsed_milliseconds":14731,"source":"multiple_migrations_0","target":"multiple_migrations_1","path":"phd_tests::migrate::multiple_migrations","source_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10582024-03-22T05:05:29.866Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.621805586Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10592024-03-22T05:05:29.867Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.621851237Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"echo Hello world","timeout_duration":"Explicit(15s)","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10602024-03-22T05:05:29.867Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.633382812Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","elapsed_milliseconds":11,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1"}
10612024-03-22T05:05:29.867Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.633553438Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10622024-03-22T05:05:29.867Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.633602519Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10632024-03-22T05:05:29.896Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.655154103Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","elapsed_milliseconds":21,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1"}
10642024-03-22T05:05:29.896Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.655285367Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10652024-03-22T05:05:29.896Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9002","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.655365899Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"61370012-c028-4da7-85ae-6af59e13b292","timeout_duration":"45s","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10662024-03-22T05:05:29.896Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.655462592Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10672024-03-22T05:05:29.976Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.774194169Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 971feb8d-8a0f-410d-b25c-ebf05a715081, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 354bacaa-3c3d-4e74-983a-f7a33d0e6c5d, silo_id: d70ea1c0-febd-4b3b-8b6c-08ae3c30c58c }, name: \"phd-vm-971feb8d-8a0f-410d-b25c-ebf05a715081\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10682024-03-22T05:05:30.001Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.774295502Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","elapsed_milliseconds":118,"vm":"multiple_migrations_2","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10692024-03-22T05:05:30.001Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:29.774345193Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","migration_id":"61370012-c028-4da7-85ae-6af59e13b292","source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10702024-03-22T05:05:41.517Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:41.316712373Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9004\",\"from_start\":7657}}"}
10712024-03-22T05:05:48.863Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.661984255Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10722024-03-22T05:05:48.863Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.662044607Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","migration_id":"61370012-c028-4da7-85ae-6af59e13b292","source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","elapsed_milliseconds":18887,"source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10732024-03-22T05:05:48.888Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.662089249Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","elapsed_milliseconds":19006,"source":"multiple_migrations_1","target":"multiple_migrations_2","path":"phd_tests::migrate::multiple_migrations","source_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10742024-03-22T05:05:48.888Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.662237403Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10752024-03-22T05:05:48.888Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.662282455Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"echo I have migrated!","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10762024-03-22T05:05:48.888Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.673793969Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","elapsed_milliseconds":11,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2"}
10772024-03-22T05:05:48.888Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.674017256Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10782024-03-22T05:05:48.888Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.674100708Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10792024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.70595664Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","elapsed_milliseconds":31,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2"}
10802024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.706086033Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10812024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.706217217Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10822024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.706377973Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10832024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.706603439Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
10842024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::multiple_migrations ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.706695322Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
10852024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.706724123Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":38084}
10862024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.706772395Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
10872024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.707523368Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10882024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.707978762Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352"}
10892024-03-22T05:05:48.914Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.708009403Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012"}
10902024-03-22T05:05:49.047Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.846888689Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"1a3b1cf6-96ec-4ce8-9d5e-0849db71a352","elapsed_milliseconds":140,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_1"}
10912024-03-22T05:05:49.159Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:48.955182334Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"afa7da7a-2f28-4970-90ff-96bac2b81012","elapsed_milliseconds":248,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_0"}
10922024-03-22T05:05:49.423Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.223375632Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9004","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10932024-03-22T05:05:49.558Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.357438431Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10942024-03-22T05:05:49.583Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.357543474Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-89507ae6-4c87-4608-bf16-df9d3bae1061\"]","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10952024-03-22T05:05:49.608Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.391388926Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10962024-03-22T05:05:49.608Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.391442688Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-ce8ca069-1208-449d-b97f-e6dd907d3917\"]","path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081"}
10972024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.41260769Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"971feb8d-8a0f-410d-b25c-ebf05a715081","elapsed_milliseconds":706,"path":"phd_tests::migrate::multiple_migrations","vm":"multiple_migrations_2"}
10982024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.412676202Z","target":"phd_tests::migrate","line":291,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::multiple_migrations","elapsed_milliseconds":39012}
10992024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.412848787Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":706}
11002024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::incompatible_vms","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.412916159Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
11012024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.41295354Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
11022024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.412985552Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
11032024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.413078894Z","target":"phd_tests::migrate","line":248,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::incompatible_vms"}
11042024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.413150906Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::incompatible_vms"}
11052024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.413306901Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::incompatible_vms"}
11062024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.413358883Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::incompatible_vms"}
11072024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.413405254Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::incompatible_vms"}
11082024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.427466617Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 650M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::incompatible_vms"}
11092024-03-22T05:05:49.635Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.42756391Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-1c5f4ead-5001-4570-98af-a3e147b82659\"]","path":"phd_tests::migrate::incompatible_vms"}
11102024-03-22T05:05:49.661Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.446921746Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-1c5f4ead-5001-4570-98af-a3e147b82659\", \"phd-artifacts/phd-clone-3cd0a839-c039-4b59-bd6f-40ada7839e14\"]","path":"phd_tests::migrate::incompatible_vms"}
11112024-03-22T05:05:49.687Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.4665209Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-3cd0a839-c039-4b59-bd6f-40ada7839e14\"]","verb":"list","path":"phd_tests::migrate::incompatible_vms"}
11122024-03-22T05:05:49.687Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.482408889Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-3cd0a839-c039-4b59-bd6f-40ada7839e14 0B 1.80T 649M /phd-artifacts/phd-clone-3cd0a839-c039-4b59-bd6f-40ada7839e14\n","path":"phd_tests::migrate::incompatible_vms"}
11132024-03-22T05:05:49.687Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.483110861Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms"}
11142024-03-22T05:05:49.687Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.483272976Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-3cd0a839-c039-4b59-bd6f-40ada7839e14/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","vm_name":"migration_incompatible_source_0","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::migrate::incompatible_vms"}
11152024-03-22T05:05:49.687Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.48339855Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::incompatible_vms"}
11162024-03-22T05:05:49.687Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.483468232Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migration_incompatible_source_0.config.toml\"","server_addr":"127.0.0.1:9000","path":"phd_tests::migrate::incompatible_vms"}
11172024-03-22T05:05:49.687Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.483510913Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_incompatible_source_0.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_incompatible_source_0.stderr.log\"","path":"phd_tests::migrate::incompatible_vms"}
11182024-03-22T05:05:49.712Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 967","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.493050137Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::incompatible_vms"}
11192024-03-22T05:05:49.712Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.493496071Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","elapsed_milliseconds":10}
11202024-03-22T05:05:49.712Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.493566233Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11212024-03-22T05:05:49.712Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:49.494051828Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11222024-03-22T05:05:50.278Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.078054431Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
11232024-03-22T05:05:50.326Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.078853626Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-3cd0a839-c039-4b59-bd6f-40ada7839e14/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: b75bee3b-6dda-4132-a48e-1e53e1b4f2cb, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 5dc9cbc5-5379-458f-b129-e49cf853b619, silo_id: 21f4e67c-bddc-4bd6-8431-704fc62fcc93 }, name: \"phd-vm-b75bee3b-6dda-4132-a48e-1e53e1b4f2cb\", vcpus: 4 }, state: Creating }","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11242024-03-22T05:05:50.326Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.078929498Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":585,"vm":"migration_incompatible_source_0","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb"}
11252024-03-22T05:05:50.326Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.07897517Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11262024-03-22T05:05:50.326Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.079010961Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11272024-03-22T05:05:50.326Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.079569468Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm":"migration_incompatible_source_0","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb"}
11282024-03-22T05:05:50.327Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.07962931Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::incompatible_vms"}
11292024-03-22T05:05:50.327Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.079769564Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::incompatible_vms"}
11302024-03-22T05:05:50.327Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.079810805Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::incompatible_vms"}
11312024-03-22T05:05:50.327Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.079852257Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::incompatible_vms"}
11322024-03-22T05:05:50.327Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.095284462Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 650M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::incompatible_vms"}
11332024-03-22T05:05:50.327Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.095399475Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-7d61faed-656d-4537-b205-b21b0e204082\"]","verb":"snapshot","path":"phd_tests::migrate::incompatible_vms"}
11342024-03-22T05:05:50.366Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.1169804Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-7d61faed-656d-4537-b205-b21b0e204082\", \"phd-artifacts/phd-clone-8bcd26fc-df42-40ba-aeef-e6ac6452d72b\"]","verb":"clone","path":"phd_tests::migrate::incompatible_vms"}
11352024-03-22T05:05:50.366Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.137558634Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-8bcd26fc-df42-40ba-aeef-e6ac6452d72b\"]","path":"phd_tests::migrate::incompatible_vms"}
11362024-03-22T05:05:50.392Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.152729561Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-8bcd26fc-df42-40ba-aeef-e6ac6452d72b 0B 1.80T 649M /phd-artifacts/phd-clone-8bcd26fc-df42-40ba-aeef-e6ac6452d72b\n","path":"phd_tests::migrate::incompatible_vms"}
11372024-03-22T05:05:50.392Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.153414432Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms"}
11382024-03-22T05:05:50.392Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.153495755Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","vm_name":"migration_incompatible_target_1","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-8bcd26fc-df42-40ba-aeef-e6ac6452d72b/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 8, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::migrate::incompatible_vms"}
11392024-03-22T05:05:50.392Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.153568017Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::incompatible_vms"}
11402024-03-22T05:05:50.392Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.153634719Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9002","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migration_incompatible_target_1.config.toml\"","path":"phd_tests::migrate::incompatible_vms"}
11412024-03-22T05:05:50.392Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.15367701Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_incompatible_target_1.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_incompatible_target_1.stdout.log\"","path":"phd_tests::migrate::incompatible_vms"}
11422024-03-22T05:05:50.392Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 972","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.163027158Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::incompatible_vms"}
11432024-03-22T05:05:50.392Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.163496363Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","elapsed_milliseconds":10}
11442024-03-22T05:05:50.393Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.163572915Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11452024-03-22T05:05:50.393Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.163621176Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"bc0af39c-2d8c-4617-b3da-bd19c52354c9","timeout_duration":"45s","target":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11462024-03-22T05:05:50.393Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.163673998Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","target":"migration_incompatible_target_1","vm":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11472024-03-22T05:05:50.393Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.164098881Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","target":"migration_incompatible_target_1","vm":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11482024-03-22T05:05:51.062Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.86191042Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 527bc8b3-7bcc-4c57-baff-d9e862a5fb77, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 0d4ccbb7-8ab7-48d8-bae2-abfb325e224c, silo_id: 681a9121-b37e-426b-9539-1edc20702df3 }, name: \"phd-vm-527bc8b3-7bcc-4c57-baff-d9e862a5fb77\", vcpus: 8 }, state: Failed }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-8bcd26fc-df42-40ba-aeef-e6ac6452d72b/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 8, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","target":"migration_incompatible_target_1","vm":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11492024-03-22T05:05:51.111Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.862012423Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_incompatible_target_1","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","elapsed_milliseconds":698,"target":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11502024-03-22T05:05:51.111Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.862065285Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"bc0af39c-2d8c-4617-b3da-bd19c52354c9","target":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11512024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Instance reported error during migration","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.862605032Z","target":"phd_framework::test_vm","line":537,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11522024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.862765446Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"bc0af39c-2d8c-4617-b3da-bd19c52354c9","elapsed_milliseconds":0,"target":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11532024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.862804568Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":699,"target":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_0","source_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","target_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11542024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.864118748Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","vm":"migration_incompatible_target_1"}
11552024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.864205201Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11562024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.864308014Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::incompatible_vms"}
11572024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.864443588Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::incompatible_vms"}
11582024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.86449221Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::incompatible_vms"}
11592024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.864534521Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","verb":"list","path":"phd_tests::migrate::incompatible_vms"}
11602024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.872682532Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11612024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.872808876Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","vm":"migration_incompatible_target_1"}
11622024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.880702649Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 650M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::incompatible_vms"}
11632024-03-22T05:05:51.112Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.880791621Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-d3c83bca-cfbc-4491-b102-0e09bd089015\"]","path":"phd_tests::migrate::incompatible_vms"}
11642024-03-22T05:05:51.139Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.904484651Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-d3c83bca-cfbc-4491-b102-0e09bd089015\", \"phd-artifacts/phd-clone-260378a3-f8cd-4463-b00b-0360773819ba\"]","verb":"clone","path":"phd_tests::migrate::incompatible_vms"}
11652024-03-22T05:05:51.139Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.925386565Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-260378a3-f8cd-4463-b00b-0360773819ba\"]","path":"phd_tests::migrate::incompatible_vms"}
11662024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.940544842Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-260378a3-f8cd-4463-b00b-0360773819ba 0B 1.80T 649M /phd-artifacts/phd-clone-260378a3-f8cd-4463-b00b-0360773819ba\n","path":"phd_tests::migrate::incompatible_vms"}
11672024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.941095549Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms"}
11682024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.941189832Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-260378a3-f8cd-4463-b00b-0360773819ba/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"migration_incompatible_source_1","path":"phd_tests::migrate::incompatible_vms"}
11692024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.941272624Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::incompatible_vms"}
11702024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.941351826Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","config_toml_path":"\"/tmp/propolis-phd/migration_incompatible_source_1.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9004","path":"phd_tests::migrate::incompatible_vms"}
11712024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.941396518Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_incompatible_source_1.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_incompatible_source_1.stderr.log\"","path":"phd_tests::migrate::incompatible_vms"}
11722024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 977","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.949653722Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::incompatible_vms"}
11732024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.950042124Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","elapsed_milliseconds":8}
11742024-03-22T05:05:51.165Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.950127777Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
11752024-03-22T05:05:51.166Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.95056659Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9004/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
11762024-03-22T05:05:51.166Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial websocket closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.950704925Z","target":"phd_framework::serial","line":271,"file":"phd-tests/framework/src/serial/mod.rs"}
11772024-03-22T05:05:51.166Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:50.950801208Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":872}
11782024-03-22T05:05:51.446Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.2386034Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","vm":"migration_incompatible_target_1"}
11792024-03-22T05:05:51.576Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.375794425Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","vm":"migration_incompatible_target_1"}
11802024-03-22T05:05:51.602Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.375894608Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-8bcd26fc-df42-40ba-aeef-e6ac6452d72b\"]","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","vm":"migration_incompatible_target_1"}
11812024-03-22T05:05:51.627Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.411055401Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","vm":"migration_incompatible_target_1"}
11822024-03-22T05:05:51.627Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.411121213Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-7d61faed-656d-4537-b205-b21b0e204082\"]","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77","vm":"migration_incompatible_target_1"}
11832024-03-22T05:05:51.652Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.438485455Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":574,"vm":"migration_incompatible_target_1","path":"phd_tests::migrate::incompatible_vms","vm_id":"527bc8b3-7bcc-4c57-baff-d9e862a5fb77"}
11842024-03-22T05:05:51.678Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.457631445Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11852024-03-22T05:05:51.790Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.589666191Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11862024-03-22T05:05:51.815Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.589766874Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-3cd0a839-c039-4b59-bd6f-40ada7839e14\"]","verb":"destroy","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11872024-03-22T05:05:51.840Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.62045965Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11882024-03-22T05:05:51.840Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.620511271Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-1c5f4ead-5001-4570-98af-a3e147b82659\"]","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb","vm":"migration_incompatible_source_0"}
11892024-03-22T05:05:51.865Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.644062706Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":779,"vm":"migration_incompatible_source_0","path":"phd_tests::migrate::incompatible_vms","vm_id":"b75bee3b-6dda-4132-a48e-1e53e1b4f2cb"}
11902024-03-22T05:05:52.016Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.815433594Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
11912024-03-22T05:05:52.045Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.815934279Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-260378a3-f8cd-4463-b00b-0360773819ba/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 4, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 7aa16e1a-47c9-4483-979b-8e49f6e64cca, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: c28b69e5-c364-4a81-8886-0dc701028e32, silo_id: f3b56703-98eb-4608-8381-a0b6804ceb03 }, name: \"phd-vm-7aa16e1a-47c9-4483-979b-8e49f6e64cca\", vcpus: 4 }, state: Creating }","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
11922024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.816019662Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":865,"vm":"migration_incompatible_source_1","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca"}
11932024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.816084084Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
11942024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.816120685Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
11952024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.81661983Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm":"migration_incompatible_source_1","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca"}
11962024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.816686642Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::incompatible_vms"}
11972024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.816837567Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::incompatible_vms"}
11982024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.816878868Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::incompatible_vms"}
11992024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.816927Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::incompatible_vms"}
12002024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.838239016Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 650M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::incompatible_vms"}
12012024-03-22T05:05:52.046Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.83837158Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-e58cfcb4-cd6f-4c71-b756-da34ac0ad346\"]","path":"phd_tests::migrate::incompatible_vms"}
12022024-03-22T05:05:52.072Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.863435092Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-e58cfcb4-cd6f-4c71-b756-da34ac0ad346\", \"phd-artifacts/phd-clone-7cb50f98-7d90-456d-9ace-664a29e8de8d\"]","verb":"clone","path":"phd_tests::migrate::incompatible_vms"}
12032024-03-22T05:05:52.097Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.884863812Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-7cb50f98-7d90-456d-9ace-664a29e8de8d\"]","verb":"list","path":"phd_tests::migrate::incompatible_vms"}
12042024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.899220844Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-7cb50f98-7d90-456d-9ace-664a29e8de8d 0B 1.80T 649M /phd-artifacts/phd-clone-7cb50f98-7d90-456d-9ace-664a29e8de8d\n","path":"phd_tests::migrate::incompatible_vms"}
12052024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.899781631Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms"}
12062024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.899864194Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"migration_incompatible_target_2","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-7cb50f98-7d90-456d-9ace-664a29e8de8d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 1024 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::migrate::incompatible_vms"}
12072024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.899935926Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::incompatible_vms"}
12082024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.900004558Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migration_incompatible_target_2.config.toml\"","server_addr":"127.0.0.1:9006","path":"phd_tests::migrate::incompatible_vms"}
12092024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.900044849Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_incompatible_target_2.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_incompatible_target_2.stderr.log\"","path":"phd_tests::migrate::incompatible_vms"}
12102024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 988","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.909319955Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::incompatible_vms"}
12112024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.909726527Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","elapsed_milliseconds":9}
12122024-03-22T05:05:52.122Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.90982428Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12132024-03-22T05:05:52.123Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9004","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.909879622Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"90s","migration_id":"5d4d2187-6cb6-4c91-bbb5-58f7825f8f8d","target":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12142024-03-22T05:05:52.123Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.909946224Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","target":"migration_incompatible_target_2","vm":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12152024-03-22T05:05:52.123Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:51.910439279Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9006/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","target":"migration_incompatible_target_2","vm":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12162024-03-22T05:05:53.332Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.718975647Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 0e25c839-6f34-4c4a-bb49-ef591ced525b, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 020f2177-511b-4a2c-950d-ff0db65ed267, silo_id: 1e15d762-73c6-46d5-9fa8-734d6197c356 }, name: \"phd-vm-0e25c839-6f34-4c4a-bb49-ef591ced525b\", vcpus: 2 }, state: Failed }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-7cb50f98-7d90-456d-9ace-664a29e8de8d/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 1024 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","target":"migration_incompatible_target_2","vm":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12172024-03-22T05:05:53.380Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.719103201Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_incompatible_target_2","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","elapsed_milliseconds":809,"target":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12182024-03-22T05:05:53.380Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.719182124Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"5d4d2187-6cb6-4c91-bbb5-58f7825f8f8d","target":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12192024-03-22T05:05:53.380Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Instance reported error during migration","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.71970662Z","target":"phd_framework::test_vm","line":537,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12202024-03-22T05:05:53.380Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.719898456Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"5d4d2187-6cb6-4c91-bbb5-58f7825f8f8d","elapsed_milliseconds":0,"target":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12212024-03-22T05:05:53.380Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.719940287Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":810,"target":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","source":"migration_incompatible_source_1","source_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","target_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12222024-03-22T05:05:53.380Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.72102769Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","vm":"migration_incompatible_target_2"}
12232024-03-22T05:05:53.381Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.721108883Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
12242024-03-22T05:05:53.381Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.721249527Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
12252024-03-22T05:05:53.381Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::incompatible_vms ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.721291989Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
12262024-03-22T05:05:53.381Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.72134103Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":905}
12272024-03-22T05:05:53.381Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.72135296Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
12282024-03-22T05:05:53.381Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.721918188Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","vm":"migration_incompatible_target_2"}
12292024-03-22T05:05:53.381Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.722343301Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
12302024-03-22T05:05:53.381Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:52.978671524Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9006","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","vm":"migration_incompatible_target_2"}
12312024-03-22T05:05:53.429Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.229080875Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","vm":"migration_incompatible_target_2"}
12322024-03-22T05:05:53.454Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.229187698Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-7cb50f98-7d90-456d-9ace-664a29e8de8d\"]","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","vm":"migration_incompatible_target_2"}
12332024-03-22T05:05:53.484Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.268902472Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","vm":"migration_incompatible_target_2"}
12342024-03-22T05:05:53.484Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.268958133Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-e58cfcb4-cd6f-4c71-b756-da34ac0ad346\"]","verb":"destroy","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b","vm":"migration_incompatible_target_2"}
12352024-03-22T05:05:53.509Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.292653553Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":571,"vm":"migration_incompatible_target_2","path":"phd_tests::migrate::incompatible_vms","vm_id":"0e25c839-6f34-4c4a-bb49-ef591ced525b"}
12362024-03-22T05:05:53.509Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.293508149Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9004","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
12372024-03-22T05:05:53.621Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.420880932Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
12382024-03-22T05:05:53.649Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.420980845Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-260378a3-f8cd-4463-b00b-0360773819ba\"]","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
12392024-03-22T05:05:53.674Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.44909014Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
12402024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.449151402Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-d3c83bca-cfbc-4491-b102-0e09bd089015\"]","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca","vm":"migration_incompatible_source_1"}
12412024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.46952969Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":748,"vm":"migration_incompatible_source_1","path":"phd_tests::migrate::incompatible_vms","vm_id":"7aa16e1a-47c9-4483-979b-8e49f6e64cca"}
12422024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.469600822Z","target":"phd_tests::migrate","line":248,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::incompatible_vms","elapsed_milliseconds":4056}
12432024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.46984566Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":748}
12442024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::serial_history","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.469948773Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
12452024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.469994454Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
12462024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.470031225Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
12472024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.470167879Z","target":"phd_tests::migrate","line":18,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::serial_history"}
12482024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.470267673Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::serial_history"}
12492024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.470460218Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::serial_history"}
12502024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.47051371Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::serial_history"}
12512024-03-22T05:05:53.675Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.470565622Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::serial_history"}
12522024-03-22T05:05:53.701Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.492443675Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 651M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::serial_history"}
12532024-03-22T05:05:53.701Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.492534208Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-00212524-df9c-4430-abbd-8a4eb780cc4c\"]","path":"phd_tests::migrate::serial_history"}
12542024-03-22T05:05:53.726Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.517674542Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-00212524-df9c-4430-abbd-8a4eb780cc4c\", \"phd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180\"]","path":"phd_tests::migrate::serial_history"}
12552024-03-22T05:05:53.761Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.538329058Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180\"]","verb":"list","path":"phd_tests::migrate::serial_history"}
12562024-03-22T05:05:53.791Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.553744403Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180 0B 1.80T 649M /phd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180\n","path":"phd_tests::migrate::serial_history"}
12572024-03-22T05:05:53.791Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.554459515Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history"}
12582024-03-22T05:05:53.792Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.554580809Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","vm_name":"migration_serial_history","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::migrate::serial_history"}
12592024-03-22T05:05:53.792Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.554652101Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::serial_history"}
12602024-03-22T05:05:53.792Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.554721783Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","config_toml_path":"\"/tmp/propolis-phd/migration_serial_history.config.toml\"","server_addr":"127.0.0.1:9000","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::migrate::serial_history"}
12612024-03-22T05:05:53.792Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.554765635Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_serial_history.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_serial_history.stderr.log\"","path":"phd_tests::migrate::serial_history"}
12622024-03-22T05:05:53.792Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 999","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.564339729Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::serial_history"}
12632024-03-22T05:05:53.792Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.564898557Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","elapsed_milliseconds":10}
12642024-03-22T05:05:53.792Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.565029511Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12652024-03-22T05:05:53.792Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.565735262Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12662024-03-22T05:05:54.150Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.949456519Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
12672024-03-22T05:05:54.176Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.950435149Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 19900628-2285-4e9c-881f-09431309b932, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 2b471402-de64-48fb-8031-194cdde23dd5, silo_id: fe8877b3-1254-4cd4-821e-2cd27b1c2760 }, name: \"phd-vm-19900628-2285-4e9c-881f-09431309b932\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12682024-03-22T05:05:54.176Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.950540272Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","vm":"migration_serial_history","elapsed_milliseconds":385,"vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12692024-03-22T05:05:54.176Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.950647976Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12702024-03-22T05:05:54.176Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.950686817Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12712024-03-22T05:05:54.176Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.951287146Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","vm":"migration_serial_history","elapsed_milliseconds":0,"vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12722024-03-22T05:05:54.177Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.951341717Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history"}
12732024-03-22T05:05:54.177Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.951384529Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932","timeout_duration":"300s","path":"phd_tests::migrate::serial_history"}
12742024-03-22T05:05:54.177Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.95141911Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::serial_history"}
12752024-03-22T05:05:54.177Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.951453031Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12762024-03-22T05:05:54.177Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:53.951486252Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12772024-03-22T05:05:58.371Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.170501272Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","vm":"migration_serial_history","elapsed_milliseconds":4218,"vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12782024-03-22T05:05:58.397Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.170587025Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::serial_history"}
12792024-03-22T05:05:58.398Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.17076994Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::serial_history"}
12802024-03-22T05:05:58.398Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.170822272Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12812024-03-22T05:05:58.398Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.170858513Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12822024-03-22T05:05:58.398Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.190504068Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","vm":"migration_serial_history","elapsed_milliseconds":19,"vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12832024-03-22T05:05:58.398Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.190588791Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history"}
12842024-03-22T05:05:58.398Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.190620472Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","elapsed_milliseconds":4239}
12852024-03-22T05:05:58.398Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.190762816Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12862024-03-22T05:05:58.398Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.190807177Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"echo hello from the source VM!","timeout_duration":"Explicit(15s)","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12872024-03-22T05:05:58.431Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.200215127Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","vm":"migration_serial_history","elapsed_milliseconds":9,"vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12882024-03-22T05:05:58.431Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.200340301Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12892024-03-22T05:05:58.431Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.200382112Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12902024-03-22T05:05:58.457Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.232045227Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","vm":"migration_serial_history","elapsed_milliseconds":31,"vm_id":"19900628-2285-4e9c-881f-09431309b932"}
12912024-03-22T05:05:58.457Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.236238496Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","propolis_artifact":"__DEFAULT_PROPOLIS","vm_name":"migration_serial_history","path":"phd_tests::migrate::serial_history"}
12922024-03-22T05:05:58.457Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.236298518Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history"}
12932024-03-22T05:05:58.457Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.23636782Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"migration_serial_history_lifecycle_0","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","path":"phd_tests::migrate::serial_history"}
12942024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.236431242Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::serial_history"}
12952024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.236500234Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9002","config_toml_path":"\"/tmp/propolis-phd/migration_serial_history_lifecycle_0.config.toml\"","path":"phd_tests::migrate::serial_history"}
12962024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.236539086Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_serial_history_lifecycle_0.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_serial_history_lifecycle_0.stdout.log\"","path":"phd_tests::migrate::serial_history"}
12972024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.251728953Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::serial_history"}
12982024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.25225805Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","elapsed_milliseconds":15}
12992024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.252390424Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13002024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.252478166Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"11b6dcd2-775b-46eb-80ef-f1f5fa2449fa","timeout_duration":"45s","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13012024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.25258066Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","vm":"migration_serial_history_lifecycle_0","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235","target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13022024-03-22T05:05:58.458Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.253098316Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","vm":"migration_serial_history_lifecycle_0","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235","target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13032024-03-22T05:05:58.950Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.748806841Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: c313c6cb-9752-4e40-b47e-61fd6befa235, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: f83fefcb-3d16-41be-90e8-0cec4f246331, silo_id: 85531350-5e05-450c-891f-2834e447fba1 }, name: \"phd-vm-c313c6cb-9752-4e40-b47e-61fd6befa235\", vcpus: 2 }, state: Migrating }","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","vm":"migration_serial_history_lifecycle_0","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235","target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13042024-03-22T05:05:58.976Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.748916984Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"19900628-2285-4e9c-881f-09431309b932","source":"migration_serial_history","vm":"migration_serial_history_lifecycle_0","elapsed_milliseconds":496,"vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235","target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235","path":"phd_tests::migrate::serial_history","target":"migration_serial_history_lifecycle_0"}
13052024-03-22T05:05:58.976Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:05:58.748985676Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","migration_id":"11b6dcd2-775b-46eb-80ef-f1f5fa2449fa","target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13062024-03-22T05:06:10.396Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:10.195478614Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9002\",\"from_start\":7685}}"}
13072024-03-22T05:06:11.945Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.739711028Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13082024-03-22T05:06:11.945Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.739763859Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","migration_id":"11b6dcd2-775b-46eb-80ef-f1f5fa2449fa","elapsed_milliseconds":12990,"target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13092024-03-22T05:06:11.974Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.739809721Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"19900628-2285-4e9c-881f-09431309b932","path":"phd_tests::migrate::serial_history","source":"migration_serial_history","target":"migration_serial_history_lifecycle_0","elapsed_milliseconds":13487,"target_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13102024-03-22T05:06:11.974Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.741351198Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
13112024-03-22T05:06:11.974Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.74239458Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm":"migration_serial_history","path":"phd_tests::migrate::serial_history","vm_id":"19900628-2285-4e9c-881f-09431309b932"}
13122024-03-22T05:06:12.078Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.874913841Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","vm":"migration_serial_history","elapsed_milliseconds":133,"vm_id":"19900628-2285-4e9c-881f-09431309b932"}
13132024-03-22T05:06:12.104Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.877589444Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history_lifecycle_0","path":"phd_tests::migrate::serial_history","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13142024-03-22T05:06:12.104Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.877817191Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
13152024-03-22T05:06:12.104Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::serial_history ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.877904603Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
13162024-03-22T05:06:12.104Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.877950095Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":17928}
13172024-03-22T05:06:12.104Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.878033007Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
13182024-03-22T05:06:12.104Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:11.878589945Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_serial_history_lifecycle_0","path":"phd_tests::migrate::serial_history","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13192024-03-22T05:06:12.470Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.270103761Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm":"migration_serial_history_lifecycle_0","path":"phd_tests::migrate::serial_history","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13202024-03-22T05:06:12.605Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.404652364Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_serial_history_lifecycle_0","path":"phd_tests::migrate::serial_history","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13212024-03-22T05:06:12.630Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.404757117Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-7607042a-e7f8-46eb-861f-b3d5bb224180\"]","vm":"migration_serial_history_lifecycle_0","path":"phd_tests::migrate::serial_history","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13222024-03-22T05:06:12.681Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.434895525Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_serial_history_lifecycle_0","path":"phd_tests::migrate::serial_history","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13232024-03-22T05:06:12.681Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.434950907Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-00212524-df9c-4430-abbd-8a4eb780cc4c\"]","vm":"migration_serial_history_lifecycle_0","path":"phd_tests::migrate::serial_history","vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13242024-03-22T05:06:12.708Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457100929Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::serial_history","vm":"migration_serial_history_lifecycle_0","elapsed_milliseconds":579,"vm_id":"c313c6cb-9752-4e40-b47e-61fd6befa235"}
13252024-03-22T05:06:12.708Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457174711Z","target":"phd_tests::migrate","line":18,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::serial_history","elapsed_milliseconds":18986}
13262024-03-22T05:06:12.708Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457342496Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":579}
13272024-03-22T05:06:12.708Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::smoke_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457401978Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
13282024-03-22T05:06:12.708Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457430749Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
13292024-03-22T05:06:12.709Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.45745861Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
13302024-03-22T05:06:12.709Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457557343Z","target":"phd_tests::migrate","line":13,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::smoke_test"}
13312024-03-22T05:06:12.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457629145Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::smoke_test"}
13322024-03-22T05:06:12.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.45778851Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::smoke_test"}
13332024-03-22T05:06:12.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457840292Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::smoke_test"}
13342024-03-22T05:06:12.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.457885873Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::smoke_test"}
13352024-03-22T05:06:12.710Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.473453103Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 650M 1.80T 649M /phd-artifacts\n","path":"phd_tests::migrate::smoke_test"}
13362024-03-22T05:06:12.710Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.473598147Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-b523ec30-460e-4ec7-9c25-098830d64580\"]","path":"phd_tests::migrate::smoke_test"}
13372024-03-22T05:06:12.710Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.492043855Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-b523ec30-460e-4ec7-9c25-098830d64580\", \"phd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd\"]","path":"phd_tests::migrate::smoke_test"}
13382024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.511879536Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd\"]","verb":"list","path":"phd_tests::migrate::smoke_test"}
13392024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.527028833Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd 0B 1.80T 649M /phd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd\n","path":"phd_tests::migrate::smoke_test"}
13402024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.527652422Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::smoke_test"}
13412024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.527740494Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13422024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.527824317Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::smoke_test"}
13432024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.527899329Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9000","config_toml_path":"\"/tmp/propolis-phd/migration_smoke.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::migrate::smoke_test"}
13442024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.527939521Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_smoke.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_smoke.stderr.log\"","path":"phd_tests::migrate::smoke_test"}
13452024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1009","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.537693621Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::smoke_test"}
13462024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.538284869Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":10,"path":"phd_tests::migrate::smoke_test"}
13472024-03-22T05:06:12.740Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.538380182Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13482024-03-22T05:06:12.765Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:12.538826496Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13492024-03-22T05:06:13.569Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.367069621Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
13502024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.367672509Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 37e15ac2-4821-49af-9859-0edd78901e19, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 061743af-a62f-4e90-8a5a-e07718c524d1, silo_id: 379449a9-17a9-4af2-8427-6035167d9108 }, name: \"phd-vm-37e15ac2-4821-49af-9859-0edd78901e19\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13512024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.367763422Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":829,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13522024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.367817644Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13532024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.367859265Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13542024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.368421472Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13552024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.368471894Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::smoke_test"}
13562024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.368512065Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","timeout_duration":"300s","path":"phd_tests::migrate::smoke_test"}
13572024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.368546266Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::smoke_test"}
13582024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.368580177Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13592024-03-22T05:06:13.616Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:13.368612898Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13602024-03-22T05:06:17.794Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.593412209Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4224,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13612024-03-22T05:06:17.794Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.593506041Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::smoke_test"}
13622024-03-22T05:06:17.819Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.593698067Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::smoke_test"}
13632024-03-22T05:06:17.819Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.593749499Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13642024-03-22T05:06:17.819Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.59378434Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost:~#","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13652024-03-22T05:06:17.819Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.613415615Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":19,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13662024-03-22T05:06:17.819Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.613495747Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::smoke_test"}
13672024-03-22T05:06:17.819Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.613525178Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4245,"path":"phd_tests::migrate::smoke_test"}
13682024-03-22T05:06:17.819Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.613672753Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13692024-03-22T05:06:17.819Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.613717194Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"ls foo.bar 2> /dev/null","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13702024-03-22T05:06:18.268Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.622155914Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":8,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13712024-03-22T05:06:18.268Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.622267397Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13722024-03-22T05:06:18.268Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.622307699Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13732024-03-22T05:06:18.325Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.653989344Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":31,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13742024-03-22T05:06:18.325Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.654124408Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13752024-03-22T05:06:18.325Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.65417289Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"touch ./foo.bar","timeout_duration":"Explicit(15s)","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13762024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.665466408Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":11,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13772024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.665743936Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13782024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.665842999Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13792024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.687216907Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":21,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13802024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.687370562Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13812024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.687427924Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sync ./foo.bar","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13822024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.698737862Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":11,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13832024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.698951209Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13842024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.699022831Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
13852024-03-22T05:06:18.326Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.731854062Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":32,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
13862024-03-22T05:06:18.327Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.731931754Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","vm_name":"migration_smoke","propolis_artifact":"__DEFAULT_PROPOLIS","path":"phd_tests::migrate::smoke_test"}
13872024-03-22T05:06:18.327Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.731991946Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::smoke_test"}
13882024-03-22T05:06:18.327Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.732059018Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_name":"migration_smoke_lifecycle_0","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::migrate::smoke_test"}
13892024-03-22T05:06:18.327Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.732134391Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::smoke_test"}
13902024-03-22T05:06:18.327Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.732215843Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9002","config_toml_path":"\"/tmp/propolis-phd/migration_smoke_lifecycle_0.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::migrate::smoke_test"}
13912024-03-22T05:06:18.327Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.732260634Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_smoke_lifecycle_0.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_smoke_lifecycle_0.stdout.log\"","path":"phd_tests::migrate::smoke_test"}
13922024-03-22T05:06:18.328Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1010","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.747560836Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::smoke_test"}
13932024-03-22T05:06:18.328Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.748125263Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":16,"path":"phd_tests::migrate::smoke_test"}
13942024-03-22T05:06:18.328Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.748258477Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
13952024-03-22T05:06:18.328Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.74833926Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"ecb561a5-ea6d-4316-ab74-b3f77e5a8e4b","timeout_duration":"45s","target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
13962024-03-22T05:06:18.329Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.748436103Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke_lifecycle_0","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
13972024-03-22T05:06:18.329Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:17.748922618Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm":"migration_smoke_lifecycle_0","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
13982024-03-22T05:06:18.457Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:18.256513828Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: d62a790a-156a-4514-ba76-8a28b9d6f541, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: ea972a6c-b329-41ac-8ee1-7295f6467067, silo_id: fb1e4162-5452-4ab1-941b-889af3a67e16 }, name: \"phd-vm-d62a790a-156a-4514-ba76-8a28b9d6f541\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migration_smoke_lifecycle_0","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
13992024-03-22T05:06:18.498Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:18.256617621Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","source":"migration_smoke","elapsed_milliseconds":508,"vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","vm":"migration_smoke_lifecycle_0","target":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test"}
14002024-03-22T05:06:18.499Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:18.256668493Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"ecb561a5-ea6d-4316-ab74-b3f77e5a8e4b","target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
14012024-03-22T05:06:29.944Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:29.723539667Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9002\",\"from_start\":7718}}"}
14022024-03-22T05:06:30.818Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:30.615852765Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
14032024-03-22T05:06:30.846Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:30.615926177Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"ecb561a5-ea6d-4316-ab74-b3f77e5a8e4b","elapsed_milliseconds":12359,"target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
14042024-03-22T05:06:30.846Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:30.615981599Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":12867,"target_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","target":"migration_smoke_lifecycle_0","source_id":"37e15ac2-4821-49af-9859-0edd78901e19","path":"phd_tests::migrate::smoke_test","source":"migration_smoke"}
14052024-03-22T05:06:30.846Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:30.617376442Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
14062024-03-22T05:06:30.847Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:30.617596559Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14072024-03-22T05:06:30.847Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:30.61764432Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"ls foo.bar","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14082024-03-22T05:06:30.847Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:30.618055233Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test","vm_id":"37e15ac2-4821-49af-9859-0edd78901e19"}
14092024-03-22T05:06:30.951Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:30.749763258Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":132,"vm_id":"37e15ac2-4821-49af-9859-0edd78901e19","vm":"migration_smoke","path":"phd_tests::migrate::smoke_test"}
14102024-03-22T05:06:32.277Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.074321057Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":1456,"vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test"}
14112024-03-22T05:06:32.302Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.074564425Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14122024-03-22T05:06:32.302Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.074622226Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14132024-03-22T05:06:32.327Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.107502479Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":32,"vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test"}
14142024-03-22T05:06:32.327Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.107634643Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14152024-03-22T05:06:32.327Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.107878551Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
14162024-03-22T05:06:32.327Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::smoke_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.107926382Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
14172024-03-22T05:06:32.327Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.108055396Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
14182024-03-22T05:06:32.327Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.108053106Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":18740}
14192024-03-22T05:06:32.327Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.108986245Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14202024-03-22T05:06:32.894Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.692096231Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14212024-03-22T05:06:33.023Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.821599739Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14222024-03-22T05:06:33.048Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.821667281Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-c1457b5e-dccb-48cb-8033-728710460efd\"]","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14232024-03-22T05:06:33.073Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.854370629Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14242024-03-22T05:06:33.073Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.85442563Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-b523ec30-460e-4ec7-9c25-098830d64580\"]","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test","vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541"}
14252024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.876757278Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":768,"vm_id":"d62a790a-156a-4514-ba76-8a28b9d6f541","vm":"migration_smoke_lifecycle_0","path":"phd_tests::migrate::smoke_test"}
14262024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.87683598Z","target":"phd_tests::migrate","line":13,"file":"phd-tests/tests/src/migrate.rs","elapsed_milliseconds":20419,"path":"phd_tests::migrate::smoke_test"}
14272024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.877003586Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":768}
14282024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::framework::multiline_serial_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.877068708Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
14292024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.877098328Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
14302024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.877125269Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
14312024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.877234453Z","target":"phd_tests::framework","line":10,"file":"phd-tests/tests/src/framework.rs","path":"phd_tests::framework::multiline_serial_test"}
14322024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.877308245Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::framework::multiline_serial_test"}
14332024-03-22T05:06:33.100Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.87746892Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::framework::multiline_serial_test"}
14342024-03-22T05:06:33.101Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.877516612Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::framework::multiline_serial_test"}
14352024-03-22T05:06:33.101Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.877561913Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::framework::multiline_serial_test"}
14362024-03-22T05:06:33.101Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.893895556Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 650M 1.80T 649M /phd-artifacts\n","path":"phd_tests::framework::multiline_serial_test"}
14372024-03-22T05:06:33.101Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.893990679Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-b63c9ec4-5ca9-421a-a6b9-7636ff9ef6e6\"]","verb":"snapshot","path":"phd_tests::framework::multiline_serial_test"}
14382024-03-22T05:06:33.126Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.913254422Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-b63c9ec4-5ca9-421a-a6b9-7636ff9ef6e6\", \"phd-artifacts/phd-clone-6bde669f-7ad2-4091-a3ad-3c63dfbd3684\"]","path":"phd_tests::framework::multiline_serial_test"}
14392024-03-22T05:06:33.151Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.935287431Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-6bde669f-7ad2-4091-a3ad-3c63dfbd3684\"]","path":"phd_tests::framework::multiline_serial_test"}
14402024-03-22T05:06:33.151Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.949215329Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-6bde669f-7ad2-4091-a3ad-3c63dfbd3684 0B 1.80T 649M /phd-artifacts/phd-clone-6bde669f-7ad2-4091-a3ad-3c63dfbd3684\n","path":"phd_tests::framework::multiline_serial_test"}
14412024-03-22T05:06:33.151Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.949755306Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test"}
14422024-03-22T05:06:33.151Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.949857779Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6bde669f-7ad2-4091-a3ad-3c63dfbd3684/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_name":"multiline_test","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::framework::multiline_serial_test"}
14432024-03-22T05:06:33.151Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.949937802Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::framework::multiline_serial_test"}
14442024-03-22T05:06:33.151Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.950014344Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9000","config_toml_path":"\"/tmp/propolis-phd/multiline_test.config.toml\"","path":"phd_tests::framework::multiline_serial_test"}
14452024-03-22T05:06:33.151Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.950061106Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/multiline_test.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/multiline_test.stderr.log\"","path":"phd_tests::framework::multiline_serial_test"}
14462024-03-22T05:06:33.178Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1019","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.959279289Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::framework::multiline_serial_test"}
14472024-03-22T05:06:33.178Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.959692612Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","elapsed_milliseconds":9}
14482024-03-22T05:06:33.178Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.959775665Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14492024-03-22T05:06:33.178Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:32.96027719Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14502024-03-22T05:06:33.587Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.387012811Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
14512024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.387540427Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 7dbd36b9-79e7-41b2-9269-d1ee47124d06, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: fbf7ad05-3cc0-456b-b6d4-633996c80195, silo_id: f193656d-fc0e-496a-8dd3-b3de8d6099de }, name: \"phd-vm-7dbd36b9-79e7-41b2-9269-d1ee47124d06\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-6bde669f-7ad2-4091-a3ad-3c63dfbd3684/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14522024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.38762776Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","elapsed_milliseconds":427,"vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14532024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.387688031Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14542024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.387724823Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14552024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.388231848Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","elapsed_milliseconds":0,"vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14562024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.38828346Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test"}
14572024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.388324341Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"300s","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06","vm":"multiline_test","path":"phd_tests::framework::multiline_serial_test"}
14582024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.388357862Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::framework::multiline_serial_test"}
14592024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.388390933Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14602024-03-22T05:06:33.613Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:33.388421934Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14612024-03-22T05:06:37.804Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.604200156Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","elapsed_milliseconds":4215,"vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14622024-03-22T05:06:37.805Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.604281058Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::framework::multiline_serial_test"}
14632024-03-22T05:06:37.835Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.604444483Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::framework::multiline_serial_test"}
14642024-03-22T05:06:37.835Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.604496175Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14652024-03-22T05:06:37.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.604531426Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14662024-03-22T05:06:37.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.623692106Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","elapsed_milliseconds":19,"vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14672024-03-22T05:06:37.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.623741328Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test"}
14682024-03-22T05:06:37.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.623770529Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","elapsed_milliseconds":4235}
14692024-03-22T05:06:37.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.623887882Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14702024-03-22T05:06:37.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.623929814Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"echo \\\n> hello \\\n> world","timeout_duration":"Explicit(15s)","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14712024-03-22T05:06:37.862Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.655363602Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","elapsed_milliseconds":31,"vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14722024-03-22T05:06:37.862Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.655472065Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14732024-03-22T05:06:37.862Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.655511686Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14742024-03-22T05:06:37.899Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.66472348Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","elapsed_milliseconds":9,"vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14752024-03-22T05:06:37.899Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.664803832Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14762024-03-22T05:06:37.899Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.664942106Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
14772024-03-22T05:06:37.899Z{"v":0,"name":"phd-runner","msg":"test phd_tests::framework::multiline_serial_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.664995138Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
14782024-03-22T05:06:37.900Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.665036289Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":4277}
14792024-03-22T05:06:37.900Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.66506443Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
14802024-03-22T05:06:37.900Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:37.665928157Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14812024-03-22T05:06:38.557Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.356180703Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14822024-03-22T05:06:38.684Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.484597587Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14832024-03-22T05:06:38.709Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.48466536Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-6bde669f-7ad2-4091-a3ad-3c63dfbd3684\"]","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14842024-03-22T05:06:38.738Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.518250564Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14852024-03-22T05:06:38.738Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.518312196Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-b63c9ec4-5ca9-421a-a6b9-7636ff9ef6e6\"]","verb":"destroy","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14862024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.543702258Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::framework::multiline_serial_test","vm":"multiline_test","elapsed_milliseconds":878,"vm_id":"7dbd36b9-79e7-41b2-9269-d1ee47124d06"}
14872024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.54376615Z","target":"phd_tests::framework","line":10,"file":"phd-tests/tests/src/framework.rs","path":"phd_tests::framework::multiline_serial_test","elapsed_milliseconds":5666}
14882024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.543998377Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":878}
14892024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::crucible::migrate::load_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.544083599Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
14902024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.544115831Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
14912024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.544141871Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
14922024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.544253485Z","target":"phd_tests::crucible::migrate","line":39,"file":"phd-tests/tests/src/crucible/migrate.rs","path":"phd_tests::crucible::migrate::load_test"}
14932024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.544342527Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::crucible::migrate::load_test"}
14942024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.544507063Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::crucible::migrate::load_test"}
14952024-03-22T05:06:38.776Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] checking for existing copy of artifact","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.544580955Z","target":"phd_framework::artifacts::store","line":89,"file":"phd-tests/framework/src/artifacts/store.rs","maybe_path":"/phd-artifacts/befb56700b5f07b1c345aa2fe36100e547820aa6aac67a259f58a8651b489594/crucible-nightly.tar.gz","path":"phd_tests::crucible::migrate::load_test"}
14962024-03-22T05:06:38.777Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:06:38.544649887Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/crucible/nightly-image/952c7d60d22be5198b892bec8d92f4291b9160c2/crucible-nightly.tar.gz","timeout":"600s","path":"phd_tests::crucible::migrate::load_test"}
14972024-03-22T05:07:02.168Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Extracting artifact from tarball","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:01.965171465Z","target":"phd_framework::artifacts::store","line":162,"file":"phd-tests/framework/src/artifacts/store.rs","extracted_path":"/phd-artifacts/befb56700b5f07b1c345aa2fe36100e547820aa6aac67a259f58a8651b489594/crucible-downstairs","untar_path":"target/release/crucible-downstairs","path":"phd_tests::crucible::migrate::load_test"}
14982024-03-22T05:07:02.168Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Extracting gzipped tarball...","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:01.965225997Z","target":"phd_framework::artifacts::store","line":518,"file":"phd-tests/framework/src/artifacts/store.rs","path":"phd_tests::crucible::migrate::load_test"}
14992024-03-22T05:07:06.486Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.286188727Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::crucible::migrate::load_test"}
15002024-03-22T05:07:06.512Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.286380553Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000\", \"--encrypted\", \"--uuid\", \"20ab108f-1fe6-46c5-8ddd-b83a2c7442df\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::migrate::load_test"}
15012024-03-22T05:07:06.563Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.363183558Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","status":"ExitStatus(unix_wait_status(0))","stderr":"","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.321961258Z\",\"hostname\":\"buskin\",\"pid\":1023}\n{\"msg\":\"UUID: 20ab108f-1fe6-46c5-8ddd-b83a2c7442df\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.354732327Z\",\"hostname\":\"buskin\",\"pid\":1023}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.354747178Z\",\"hostname\":\"buskin\",\"pid\":1023}\n","path":"phd_tests::crucible::migrate::load_test"}
15022024-03-22T05:07:06.588Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.363323922Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001\", \"--encrypted\", \"--uuid\", \"20ab108f-1fe6-46c5-8ddd-b83a2c7442df\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::migrate::load_test"}
15032024-03-22T05:07:06.620Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.419929805Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","stderr":"","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.380895343Z\",\"hostname\":\"buskin\",\"pid\":1024}\n{\"msg\":\"UUID: 20ab108f-1fe6-46c5-8ddd-b83a2c7442df\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.412593809Z\",\"hostname\":\"buskin\",\"pid\":1024}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.41260363Z\",\"hostname\":\"buskin\",\"pid\":1024}\n","status":"ExitStatus(unix_wait_status(0))","path":"phd_tests::crucible::migrate::load_test"}
15042024-03-22T05:07:06.645Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.420062059Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002\", \"--encrypted\", \"--uuid\", \"20ab108f-1fe6-46c5-8ddd-b83a2c7442df\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::migrate::load_test"}
15052024-03-22T05:07:06.679Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.478382665Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","status":"ExitStatus(unix_wait_status(0))","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.437420534Z\",\"hostname\":\"buskin\",\"pid\":1025}\n{\"msg\":\"UUID: 20ab108f-1fe6-46c5-8ddd-b83a2c7442df\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.470800232Z\",\"hostname\":\"buskin\",\"pid\":1025}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:06.470809502Z\",\"hostname\":\"buskin\",\"pid\":1025}\n","stderr":"","path":"phd_tests::crucible::migrate::load_test"}
15062024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.47854174Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000.stderr.log\"","path":"phd_tests::crucible::migrate::load_test"}
15072024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.478654104Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9000\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000\"]","path":"phd_tests::crucible::migrate::load_test"}
15082024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.478719996Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9000\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000\"]","path":"phd_tests::crucible::migrate::load_test"}
15092024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.488418454Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001.stderr.log\"","path":"phd_tests::crucible::migrate::load_test"}
15102024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.488533948Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9001\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001\"]","path":"phd_tests::crucible::migrate::load_test"}
15112024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.48859575Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9001\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001\"]","path":"phd_tests::crucible::migrate::load_test"}
15122024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.498242257Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002.stderr.log\"","path":"phd_tests::crucible::migrate::load_test"}
15132024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.498357821Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9002\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002\"]","path":"phd_tests::crucible::migrate::load_test"}
15142024-03-22T05:07:06.709Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.498417732Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9002\", \"--data\", \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002\"]","path":"phd_tests::crucible::migrate::load_test"}
15152024-03-22T05:07:06.735Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.508481122Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test"}
15162024-03-22T05:07:06.735Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.508568985Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"crucible_load_test_source","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"20ab108f-1fe6-46c5-8ddd-b83a2c7442df\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"d3ce3b2c-327d-45c4-b195-58e4cb5abcce\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":1,\\\"opts\\\":{\\\"id\\\":\\\"a8bdfa20-70b7-400e-b6d9-f65fd7c82c77\\\",\\\"key\\\":\\\"pODYu+hKB+y1ZHn7q46HWDjyHo6aRJcWADv2Uf9cy1Q=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::crucible::migrate::load_test"}
15172024-03-22T05:07:06.735Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.508648727Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::crucible::migrate::load_test"}
15182024-03-22T05:07:06.735Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.508716489Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9003","config_toml_path":"\"/tmp/propolis-phd/crucible_load_test_source.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::crucible::migrate::load_test"}
15192024-03-22T05:07:06.736Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.508752101Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/crucible_load_test_source.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/crucible_load_test_source.stdout.log\"","path":"phd_tests::crucible::migrate::load_test"}
15202024-03-22T05:07:06.736Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1029","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.518373667Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::crucible::migrate::load_test"}
15212024-03-22T05:07:06.736Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.518960255Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","elapsed_milliseconds":10}
15222024-03-22T05:07:06.736Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.519093629Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15232024-03-22T05:07:06.736Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:06.519732789Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15242024-03-22T05:07:07.363Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.162693839Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
15252024-03-22T05:07:07.410Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.163360079Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"20ab108f-1fe6-46c5-8ddd-b83a2c7442df\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"d3ce3b2c-327d-45c4-b195-58e4cb5abcce\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":1,\\\"opts\\\":{\\\"id\\\":\\\"a8bdfa20-70b7-400e-b6d9-f65fd7c82c77\\\",\\\"key\\\":\\\"pODYu+hKB+y1ZHn7q46HWDjyHo6aRJcWADv2Uf9cy1Q=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 6a2d730b-1741-45b4-8777-b7eca9d959ae, silo_id: d0039a4b-a010-4ded-b0a1-7ad060585cd2 }, name: \"phd-vm-91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85\", vcpus: 2 }, state: Creating }","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15262024-03-22T05:07:07.410Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.163480933Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":644,"vm":"crucible_load_test_source"}
15272024-03-22T05:07:07.410Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.163548975Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15282024-03-22T05:07:07.410Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.163587036Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15292024-03-22T05:07:07.410Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.164106022Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":0,"vm":"crucible_load_test_source"}
15302024-03-22T05:07:07.410Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.164159774Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test"}
15312024-03-22T05:07:07.410Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.164201215Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","timeout_duration":"300s","path":"phd_tests::crucible::migrate::load_test"}
15322024-03-22T05:07:07.411Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.164235796Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::crucible::migrate::load_test"}
15332024-03-22T05:07:07.411Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.164273787Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15342024-03-22T05:07:07.411Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:07.164310568Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15352024-03-22T05:07:12.131Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.930404756Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":4766,"vm":"crucible_load_test_source"}
15362024-03-22T05:07:12.131Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.930485999Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::crucible::migrate::load_test"}
15372024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.930691995Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::crucible::migrate::load_test"}
15382024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.930743796Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15392024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.930779798Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost:~#","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15402024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.95001701Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":19,"vm":"crucible_load_test_source"}
15412024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.950072242Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test"}
15422024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.950102303Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","elapsed_milliseconds":4785}
15432024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.950203366Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test"}
15442024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.950278208Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"20ab108f-1fe6-46c5-8ddd-b83a2c7442df\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"81f691d7-0b50-4caa-9efc-6f6a1fc32011\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":2,\\\"opts\\\":{\\\"id\\\":\\\"9cf34a93-2302-424d-a68f-ee6b7e1f9507\\\",\\\"key\\\":\\\"pODYu+hKB+y1ZHn7q46HWDjyHo6aRJcWADv2Uf9cy1Q=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_name":"crucible_load_test_target","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","guest_os_kind":"Alpine","path":"phd_tests::crucible::migrate::load_test"}
15452024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.95035544Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::crucible::migrate::load_test"}
15462024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.950430053Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9005","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/crucible_load_test_target.config.toml\"","path":"phd_tests::crucible::migrate::load_test"}
15472024-03-22T05:07:12.180Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.950467334Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_load_test_target.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_load_test_target.stderr.log\"","path":"phd_tests::crucible::migrate::load_test"}
15482024-03-22T05:07:12.208Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1030","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.964993461Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::crucible::migrate::load_test"}
15492024-03-22T05:07:12.208Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.96559391Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","elapsed_milliseconds":15}
15502024-03-22T05:07:12.208Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.965817477Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15512024-03-22T05:07:12.208Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.965861988Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"dd if=/dev/random of=./rand.txt bs=5M count=10","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15522024-03-22T05:07:12.208Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.971273894Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":5,"vm":"crucible_load_test_source"}
15532024-03-22T05:07:12.208Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.971386178Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15542024-03-22T05:07:12.208Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:11.971425099Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15552024-03-22T05:07:12.399Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.199155132Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":227,"vm":"crucible_load_test_source"}
15562024-03-22T05:07:12.424Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.199471441Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15572024-03-22T05:07:12.424Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.199551604Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"sha256sum rand.txt","timeout_duration":"Explicit(15s)","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15582024-03-22T05:07:12.424Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.211020387Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":11,"vm":"crucible_load_test_source"}
15592024-03-22T05:07:12.424Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.211183572Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15602024-03-22T05:07:12.424Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.211230283Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15612024-03-22T05:07:12.679Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.479493834Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":268,"vm":"crucible_load_test_source"}
15622024-03-22T05:07:12.704Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Generated SHA256 checksum: 62985406d1b4b19ef3ede59755bda1d602fb26d58eea162b75c969a4fa21716c","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.479609908Z","target":"phd_tests::crucible::migrate","line":72,"file":"phd-tests/tests/src/crucible/migrate.rs","path":"phd_tests::crucible::migrate::load_test"}
15632024-03-22T05:07:12.704Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.479823505Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15642024-03-22T05:07:12.704Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.479913927Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"dd if=./rand.txt of=./rand_new.txt &","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15652024-03-22T05:07:12.704Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.490439492Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":10,"vm":"crucible_load_test_source"}
15662024-03-22T05:07:12.705Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.490779872Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15672024-03-22T05:07:12.705Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.490898836Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15682024-03-22T05:07:12.730Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.512328786Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":21,"vm":"crucible_load_test_source"}
15692024-03-22T05:07:12.730Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.512413948Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target"}
15702024-03-22T05:07:12.730Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9003","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.51246847Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"45s","migration_id":"70bf2698-3e62-458e-82f6-07b4be856bd3","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target"}
15712024-03-22T05:07:12.730Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.512539552Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15722024-03-22T05:07:12.824Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.623630763Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"20ab108f-1fe6-46c5-8ddd-b83a2c7442df\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"81f691d7-0b50-4caa-9efc-6f6a1fc32011\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":2,\\\"opts\\\":{\\\"id\\\":\\\"9cf34a93-2302-424d-a68f-ee6b7e1f9507\\\",\\\"key\\\":\\\"pODYu+hKB+y1ZHn7q46HWDjyHo6aRJcWADv2Uf9cy1Q=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: e562ca76-8f04-4653-a974-9590e3020dba, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: e550dcc8-61b4-45f0-9c5d-2b33c76f974c, silo_id: 9a1ceeb6-3132-4a12-9a27-3462fba88133 }, name: \"phd-vm-e562ca76-8f04-4653-a974-9590e3020dba\", vcpus: 2 }, state: Migrating }","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15732024-03-22T05:07:12.852Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.623757887Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba","elapsed_milliseconds":111,"vm":"crucible_load_test_target"}
15742024-03-22T05:07:12.853Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:12.623810269Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target","migration_id":"70bf2698-3e62-458e-82f6-07b4be856bd3"}
15752024-03-22T05:07:24.269Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.062567736Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9005\",\"from_start\":7920}}"}
15762024-03-22T05:07:24.785Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.584663324Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target"}
15772024-03-22T05:07:24.810Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.584713586Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target","migration_id":"70bf2698-3e62-458e-82f6-07b4be856bd3","elapsed_milliseconds":11960}
15782024-03-22T05:07:24.810Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.584758267Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","target_id":"e562ca76-8f04-4653-a974-9590e3020dba","source":"crucible_load_test_source","source_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","target":"crucible_load_test_target","elapsed_milliseconds":12072}
15792024-03-22T05:07:24.810Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.584901362Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15802024-03-22T05:07:24.810Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.584945413Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"wait $!","timeout_duration":"Explicit(15s)","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15812024-03-22T05:07:24.810Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.596642313Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba","elapsed_milliseconds":11,"vm":"crucible_load_test_target"}
15822024-03-22T05:07:24.810Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.596932482Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15832024-03-22T05:07:24.810Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.597030315Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15842024-03-22T05:07:24.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.629801624Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba","elapsed_milliseconds":32,"vm":"crucible_load_test_target"}
15852024-03-22T05:07:24.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.630033452Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15862024-03-22T05:07:24.836Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.630114044Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sha256sum rand_new.txt","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15872024-03-22T05:07:24.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.641299248Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba","elapsed_milliseconds":11,"vm":"crucible_load_test_target"}
15882024-03-22T05:07:24.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.641536866Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15892024-03-22T05:07:24.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.641621508Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15902024-03-22T05:07:25.112Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.908766635Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba","elapsed_milliseconds":267,"vm":"crucible_load_test_target"}
15912024-03-22T05:07:25.137Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.908913689Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15922024-03-22T05:07:25.138Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.909040924Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15932024-03-22T05:07:25.138Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.90926251Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
15942024-03-22T05:07:25.138Z{"v":0,"name":"phd-runner","msg":"test phd_tests::crucible::migrate::load_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.909335002Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
15952024-03-22T05:07:25.138Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.909368514Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":17746}
15962024-03-22T05:07:25.138Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.909403775Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
15972024-03-22T05:07:25.138Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.910069895Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9003","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_source","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85"}
15982024-03-22T05:07:25.138Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:24.922371394Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
15992024-03-22T05:07:25.249Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.049477698Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"91d08bfd-cbf6-40c3-a8ce-7dbe2d963a85","elapsed_milliseconds":140,"vm":"crucible_load_test_source"}
16002024-03-22T05:07:25.769Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.568874613Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9005","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
16012024-03-22T05:07:25.890Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.688414544Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000\" } }","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
16022024-03-22T05:07:25.916Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.700370432Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000\"","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
16032024-03-22T05:07:25.916Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.711140554Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001\" } }","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
16042024-03-22T05:07:25.946Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.723292528Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001\"","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
16052024-03-22T05:07:25.946Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.733876684Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: \"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002\" } }","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
16062024-03-22T05:07:25.980Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.745212573Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002\"","path":"phd_tests::crucible::migrate::load_test","vm":"crucible_load_test_target","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba"}
16072024-03-22T05:07:25.980Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.755734737Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::load_test","vm_id":"e562ca76-8f04-4653-a974-9590e3020dba","elapsed_milliseconds":846,"vm":"crucible_load_test_target"}
16082024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.755791119Z","target":"phd_tests::crucible::migrate","line":39,"file":"phd-tests/tests/src/crucible/migrate.rs","path":"phd_tests::crucible::migrate::load_test","elapsed_milliseconds":47211}
16092024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756071817Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":846}
16102024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::crucible::migrate::smoke_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756184081Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
16112024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756236623Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
16122024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756287734Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
16132024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756420768Z","target":"phd_tests::crucible::migrate","line":10,"file":"phd-tests/tests/src/crucible/migrate.rs","path":"phd_tests::crucible::migrate::smoke_test"}
16142024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756507491Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::crucible::migrate::smoke_test"}
16152024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756681126Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::crucible::migrate::smoke_test"}
16162024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756731998Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/befb56700b5f07b1c345aa2fe36100e547820aa6aac67a259f58a8651b489594/crucible-downstairs","path":"phd_tests::crucible::migrate::smoke_test"}
16172024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756768739Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::crucible::migrate::smoke_test"}
16182024-03-22T05:07:25.981Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.756859712Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000\", \"--encrypted\", \"--uuid\", \"5df54bb5-2bb2-44f6-9042-04c0f74f1a94\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16192024-03-22T05:07:26.425Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.820674107Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","stderr":"","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.780485619Z\",\"hostname\":\"buskin\",\"pid\":1033}\n{\"msg\":\"UUID: 5df54bb5-2bb2-44f6-9042-04c0f74f1a94\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.812738533Z\",\"hostname\":\"buskin\",\"pid\":1033}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.812757973Z\",\"hostname\":\"buskin\",\"pid\":1033}\n","status":"ExitStatus(unix_wait_status(0))","path":"phd_tests::crucible::migrate::smoke_test"}
16202024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.82078635Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001\", \"--encrypted\", \"--uuid\", \"5df54bb5-2bb2-44f6-9042-04c0f74f1a94\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16212024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.881959484Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","status":"ExitStatus(unix_wait_status(0))","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.842478429Z\",\"hostname\":\"buskin\",\"pid\":1034}\n{\"msg\":\"UUID: 5df54bb5-2bb2-44f6-9042-04c0f74f1a94\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.874444153Z\",\"hostname\":\"buskin\",\"pid\":1034}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.874458163Z\",\"hostname\":\"buskin\",\"pid\":1034}\n","stderr":"","path":"phd_tests::crucible::migrate::smoke_test"}
16222024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.882065237Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002\", \"--encrypted\", \"--uuid\", \"5df54bb5-2bb2-44f6-9042-04c0f74f1a94\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16232024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.942034384Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","status":"ExitStatus(unix_wait_status(0))","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.900117364Z\",\"hostname\":\"buskin\",\"pid\":1035}\n{\"msg\":\"UUID: 5df54bb5-2bb2-44f6-9042-04c0f74f1a94\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.933932775Z\",\"hostname\":\"buskin\",\"pid\":1035}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:07:25.933942205Z\",\"hostname\":\"buskin\",\"pid\":1035}\n","stderr":"","path":"phd_tests::crucible::migrate::smoke_test"}
16242024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.942157798Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000.stderr.log\"","path":"phd_tests::crucible::migrate::smoke_test"}
16252024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.942239621Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9000\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16262024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.942288592Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9000\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16272024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.952173927Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001.stderr.log\"","path":"phd_tests::crucible::migrate::smoke_test"}
16282024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.952269719Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9001\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16292024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.952319981Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9001\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16302024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.961726921Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002.stdout.log\"","path":"phd_tests::crucible::migrate::smoke_test"}
16312024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.961807073Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9002\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16322024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.961847334Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9002\", \"--data\", \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002\"]","path":"phd_tests::crucible::migrate::smoke_test"}
16332024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.97146375Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test"}
16342024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.971597304Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"crucible_migrate_smoke_source","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"5df54bb5-2bb2-44f6-9042-04c0f74f1a94\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"03af1fd4-f975-480f-a70c-de021fefc050\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":1,\\\"opts\\\":{\\\"id\\\":\\\"becc3f22-2b06-4d23-b184-8b4da154270e\\\",\\\"key\\\":\\\"bCKwqHih6nBnD81qEiz+nvM3nI3YEPDK46z5FSOfeZU=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","guest_os_kind":"Alpine","path":"phd_tests::crucible::migrate::smoke_test"}
16352024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.971713817Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::crucible::migrate::smoke_test"}
16362024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.9718126Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9003","config_toml_path":"\"/tmp/propolis-phd/crucible_migrate_smoke_source.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::crucible::migrate::smoke_test"}
16372024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.971873602Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_migrate_smoke_source.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_migrate_smoke_source.stderr.log\"","path":"phd_tests::crucible::migrate::smoke_test"}
16382024-03-22T05:07:26.477Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1039","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.981258451Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::crucible::migrate::smoke_test"}
16392024-03-22T05:07:26.478Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.981726646Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","elapsed_milliseconds":10}
16402024-03-22T05:07:26.478Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.981832999Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16412024-03-22T05:07:26.478Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:25.982415797Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16422024-03-22T05:07:26.935Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.735750366Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
16432024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.736254091Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: fa75ed55-325b-4257-b051-78ff38888260, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 832f848f-facf-418d-9ec2-8568b24547fc, silo_id: 11d17a9e-cd7c-4703-926f-b7e4a5663d4d }, name: \"phd-vm-fa75ed55-325b-4257-b051-78ff38888260\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"5df54bb5-2bb2-44f6-9042-04c0f74f1a94\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"03af1fd4-f975-480f-a70c-de021fefc050\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":1,\\\"opts\\\":{\\\"id\\\":\\\"becc3f22-2b06-4d23-b184-8b4da154270e\\\",\\\"key\\\":\\\"bCKwqHih6nBnD81qEiz+nvM3nI3YEPDK46z5FSOfeZU=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16442024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.736362265Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":754,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16452024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.736436207Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16462024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.736473128Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16472024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.737059206Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16482024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.737114728Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test"}
16492024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.737156849Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","timeout_duration":"300s","path":"phd_tests::crucible::migrate::smoke_test"}
16502024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.73719172Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::crucible::migrate::smoke_test"}
16512024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.737223941Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16522024-03-22T05:07:26.983Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:26.737256942Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16532024-03-22T05:07:31.746Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.545610972Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4808,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16542024-03-22T05:07:31.746Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.545680023Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::crucible::migrate::smoke_test"}
16552024-03-22T05:07:31.772Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.545846299Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::crucible::migrate::smoke_test"}
16562024-03-22T05:07:31.772Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.5458947Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16572024-03-22T05:07:31.772Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.545928351Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16582024-03-22T05:07:31.772Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.565663369Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":19,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16592024-03-22T05:07:31.772Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.565751452Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test"}
16602024-03-22T05:07:31.772Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.565783493Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","elapsed_milliseconds":4828}
16612024-03-22T05:07:31.772Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.565919747Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16622024-03-22T05:07:31.772Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.565964738Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"ls foo.bar 2> /dev/null","timeout_duration":"Explicit(15s)","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16632024-03-22T05:07:31.799Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.575276285Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":9,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16642024-03-22T05:07:31.799Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.575391089Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16652024-03-22T05:07:31.799Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.57543158Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16662024-03-22T05:07:31.825Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.607025203Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":31,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16672024-03-22T05:07:31.825Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.607159787Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16682024-03-22T05:07:31.825Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.607209928Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"touch ./foo.bar","timeout_duration":"Explicit(15s)","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16692024-03-22T05:07:31.825Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.617410852Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":10,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16702024-03-22T05:07:31.825Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.617583518Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16712024-03-22T05:07:31.825Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.61766441Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16722024-03-22T05:07:31.855Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.640173404Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":22,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16732024-03-22T05:07:31.856Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.640406611Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16742024-03-22T05:07:31.856Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.640489093Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sync ./foo.bar","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16752024-03-22T05:07:32.328Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.650727689Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":10,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16762024-03-22T05:07:32.328Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.650941235Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16772024-03-22T05:07:32.328Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.651018947Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
16782024-03-22T05:07:32.328Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.683807317Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":32,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
16792024-03-22T05:07:32.328Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.684020544Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test"}
16802024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.684145448Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"5df54bb5-2bb2-44f6-9042-04c0f74f1a94\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"01a578c5-31ca-45ef-9541-788f996d064f\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":2,\\\"opts\\\":{\\\"id\\\":\\\"57dbd008-9de4-46f9-9795-f90a444d95a8\\\",\\\"key\\\":\\\"bCKwqHih6nBnD81qEiz+nvM3nI3YEPDK46z5FSOfeZU=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"crucible_migrate_smoke_target","path":"phd_tests::crucible::migrate::smoke_test"}
16812024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.684292512Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::crucible::migrate::smoke_test"}
16822024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.684423256Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","config_toml_path":"\"/tmp/propolis-phd/crucible_migrate_smoke_target.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9005","path":"phd_tests::crucible::migrate::smoke_test"}
16832024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.684505389Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_migrate_smoke_target.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_migrate_smoke_target.stderr.log\"","path":"phd_tests::crucible::migrate::smoke_test"}
16842024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1040","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.698107128Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::crucible::migrate::smoke_test"}
16852024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.69850959Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","elapsed_milliseconds":14}
16862024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.698581782Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16872024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9003","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.698627833Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"67fc576c-70ea-4b6c-8ff3-486042e04c72","timeout_duration":"45s","source_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16882024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.698689735Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"fa75ed55-325b-4257-b051-78ff38888260","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104","path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16892024-03-22T05:07:32.329Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:31.699126969Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9005/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","source_id":"fa75ed55-325b-4257-b051-78ff38888260","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104","path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16902024-03-22T05:07:32.630Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:32.429874581Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 084ef9e4-f32d-481e-b070-8f22a119a104, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 9f304c18-d113-440d-92f9-c8ad359c2993, silo_id: 061b87dc-e29d-4c5e-aaac-beae58bc39ce }, name: \"phd-vm-084ef9e4-f32d-481e-b070-8f22a119a104\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"5df54bb5-2bb2-44f6-9042-04c0f74f1a94\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"01a578c5-31ca-45ef-9541-788f996d064f\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":2,\\\"opts\\\":{\\\"id\\\":\\\"57dbd008-9de4-46f9-9795-f90a444d95a8\\\",\\\"key\\\":\\\"bCKwqHih6nBnD81qEiz+nvM3nI3YEPDK46z5FSOfeZU=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","source_id":"fa75ed55-325b-4257-b051-78ff38888260","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104","path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16912024-03-22T05:07:32.655Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:32.430004985Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104","path":"phd_tests::crucible::migrate::smoke_test","source_id":"fa75ed55-325b-4257-b051-78ff38888260","target":"crucible_migrate_smoke_target","elapsed_milliseconds":731,"vm":"crucible_migrate_smoke_target","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
16922024-03-22T05:07:32.655Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:32.430059647Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"fa75ed55-325b-4257-b051-78ff38888260","migration_id":"67fc576c-70ea-4b6c-8ff3-486042e04c72","path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16932024-03-22T05:07:45.153Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:43.929240275Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9005\",\"from_start\":7718}}"}
16942024-03-22T05:07:47.367Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.166559586Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16952024-03-22T05:07:47.367Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.166610747Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"fa75ed55-325b-4257-b051-78ff38888260","elapsed_milliseconds":14736,"migration_id":"67fc576c-70ea-4b6c-8ff3-486042e04c72","path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16962024-03-22T05:07:47.367Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.166655838Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","source_id":"fa75ed55-325b-4257-b051-78ff38888260","elapsed_milliseconds":15468,"path":"phd_tests::crucible::migrate::smoke_test","source":"crucible_migrate_smoke_source","target_id":"084ef9e4-f32d-481e-b070-8f22a119a104","target":"crucible_migrate_smoke_target"}
16972024-03-22T05:07:47.408Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.166805673Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
16982024-03-22T05:07:47.408Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.166850195Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"ls foo.bar","timeout_duration":"Explicit(15s)","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
16992024-03-22T05:07:47.408Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.178258366Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":11,"vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104","path":"phd_tests::crucible::migrate::smoke_test"}
17002024-03-22T05:07:47.408Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.178473522Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17012024-03-22T05:07:47.408Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.178555235Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17022024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.211290563Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":32,"vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104","path":"phd_tests::crucible::migrate::smoke_test"}
17032024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.211426187Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17042024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.211566021Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
17052024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.211803559Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
17062024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"test phd_tests::crucible::migrate::smoke_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.211893292Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
17072024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.211949103Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":20476}
17082024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.212015975Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
17092024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.212850541Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17102024-03-22T05:07:47.435Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.212902613Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9003","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260"}
17112024-03-22T05:07:47.547Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.346501697Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":134,"vm":"crucible_migrate_smoke_source","vm_id":"fa75ed55-325b-4257-b051-78ff38888260","path":"phd_tests::crucible::migrate::smoke_test"}
17122024-03-22T05:07:48.161Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:47.9606637Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9005","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17132024-03-22T05:07:48.309Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.108296385Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000\" } }","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17142024-03-22T05:07:48.349Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.12048013Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000\"","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17152024-03-22T05:07:48.349Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.130729006Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001\" } }","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17162024-03-22T05:07:48.349Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.142429177Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001\"","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17172024-03-22T05:07:48.386Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.152518827Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: \"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002\" } }","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17182024-03-22T05:07:48.386Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.161775942Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002\"","path":"phd_tests::crucible::migrate::smoke_test","vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104"}
17192024-03-22T05:07:48.386Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.171982837Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":960,"vm":"crucible_migrate_smoke_target","vm_id":"084ef9e4-f32d-481e-b070-8f22a119a104","path":"phd_tests::crucible::migrate::smoke_test"}
17202024-03-22T05:07:48.386Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172050219Z","target":"phd_tests::crucible::migrate","line":10,"file":"phd-tests/tests/src/crucible/migrate.rs","path":"phd_tests::crucible::migrate::smoke_test","elapsed_milliseconds":22415}
17212024-03-22T05:07:48.386Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172237175Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":960}
17222024-03-22T05:07:48.386Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::running_process::export_failure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172311857Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
17232024-03-22T05:07:48.386Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172359048Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
17242024-03-22T05:07:48.386Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172399829Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
17252024-03-22T05:07:48.387Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172550634Z","target":"phd_tests::migrate::running_process","line":172,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::running_process::export_failure"}
17262024-03-22T05:07:48.387Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172646497Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::running_process::export_failure"}
17272024-03-22T05:07:48.387Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172840883Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::running_process::export_failure"}
17282024-03-22T05:07:48.387Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172889635Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::running_process::export_failure"}
17292024-03-22T05:07:48.387Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.172939166Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::running_process::export_failure"}
17302024-03-22T05:07:48.426Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.196022527Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 766M 1.80T 765M /phd-artifacts\n","path":"phd_tests::migrate::running_process::export_failure"}
17312024-03-22T05:07:48.426Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.196161471Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-b259c9d2-8e24-4eb3-8582-d81573462942\"]","verb":"snapshot","path":"phd_tests::migrate::running_process::export_failure"}
17322024-03-22T05:07:48.426Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.216587Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-b259c9d2-8e24-4eb3-8582-d81573462942\", \"phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934\"]","path":"phd_tests::migrate::running_process::export_failure"}
17332024-03-22T05:07:48.463Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.24092724Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934\"]","path":"phd_tests::migrate::running_process::export_failure"}
17342024-03-22T05:07:48.496Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.255571671Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934 0B 1.80T 765M /phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934\n","path":"phd_tests::migrate::running_process::export_failure"}
17352024-03-22T05:07:48.496Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.256166979Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::export_failure"}
17362024-03-22T05:07:48.496Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.256268092Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"migrate_running_process::export_failure_source","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","path":"phd_tests::migrate::running_process::export_failure"}
17372024-03-22T05:07:48.496Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.256341634Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::running_process::export_failure"}
17382024-03-22T05:07:48.496Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.256410467Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_source.config.toml\"","server_addr":"127.0.0.1:9000","path":"phd_tests::migrate::running_process::export_failure"}
17392024-03-22T05:07:48.496Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.256450408Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_source.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_source.stdout.log\"","path":"phd_tests::migrate::running_process::export_failure"}
17402024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1047","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.265810826Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::running_process::export_failure"}
17412024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.26625626Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":10,"path":"phd_tests::migrate::running_process::export_failure"}
17422024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.266345133Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::export_failure"}
17432024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.266413995Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"migrate_running_process::export_failure_target1","path":"phd_tests::migrate::running_process::export_failure"}
17442024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.266474797Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::running_process::export_failure"}
17452024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.266535748Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_target1.config.toml\"","server_addr":"127.0.0.1:9002","path":"phd_tests::migrate::running_process::export_failure"}
17462024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.26657398Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_target1.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_target1.stdout.log\"","path":"phd_tests::migrate::running_process::export_failure"}
17472024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1048","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.276152875Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::running_process::export_failure"}
17482024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.276544007Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":10,"path":"phd_tests::migrate::running_process::export_failure"}
17492024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.276631109Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::export_failure"}
17502024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.276702441Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_name":"migrate_running_process::export_failure_target2","path":"phd_tests::migrate::running_process::export_failure"}
17512024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.276779094Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::running_process::export_failure"}
17522024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.276848656Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9004","config_toml_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_target2.config.toml\"","path":"phd_tests::migrate::running_process::export_failure"}
17532024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.276893837Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_target2.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migrate_running_process::export_failure_target2.stderr.log\"","path":"phd_tests::migrate::running_process::export_failure"}
17542024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1049","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.285574365Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::running_process::export_failure"}
17552024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.285910075Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":9,"path":"phd_tests::migrate::running_process::export_failure"}
17562024-03-22T05:07:48.497Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.285992978Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17572024-03-22T05:07:48.602Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.402117994Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
17582024-03-22T05:07:48.629Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.40264971Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 7722ebad-7480-457c-a380-37a6b7b37cb3, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: e7d3918d-0c6b-4793-9114-2bc897e25c95, silo_id: 2fc56b13-3c75-42d6-b72d-7fba0c8852a4 }, name: \"phd-vm-7722ebad-7480-457c-a380-37a6b7b37cb3\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17592024-03-22T05:07:48.629Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.402730033Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":116,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17602024-03-22T05:07:48.629Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.402779594Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17612024-03-22T05:07:48.629Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.402815605Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17622024-03-22T05:07:48.629Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.403493156Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17632024-03-22T05:07:48.630Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.403545527Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::export_failure"}
17642024-03-22T05:07:48.630Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.403586779Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","timeout_duration":"300s","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17652024-03-22T05:07:48.630Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.40362286Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::running_process::export_failure"}
17662024-03-22T05:07:48.630Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.403656321Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17672024-03-22T05:07:48.630Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:48.403690222Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17682024-03-22T05:07:52.814Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.614155341Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4210,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17692024-03-22T05:07:52.814Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.614237083Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::running_process::export_failure"}
17702024-03-22T05:07:52.846Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.614415689Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::running_process::export_failure"}
17712024-03-22T05:07:52.846Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.61446701Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17722024-03-22T05:07:52.846Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.614502641Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17732024-03-22T05:07:52.846Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.633871648Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":19,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17742024-03-22T05:07:52.846Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.63395059Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::export_failure"}
17752024-03-22T05:07:52.846Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.633982671Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4230,"path":"phd_tests::migrate::running_process::export_failure"}
17762024-03-22T05:07:52.846Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.634176667Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17772024-03-22T05:07:52.846Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.634222628Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"cat >dirt.sh <<'EOF'\n> #!/usr/bin/env sh\n> # a simple script for testing migration of running process memory.\n> #\n> # this script will write a bunch of \"hello\"s to an in-memory string, then\n> # suspend to wait for a migration to occur. after the migration happens, the\n> # script can be foregrounded, and it will then check that the data is still\n> # there.\n> dirt=\"hello\"\n> len=8192 # 8 KiB ought to be enough for anyone\n> \n> # store 8k of data in memory\n> i=0\n> while [ \"$i\" -lt \"$len\" ]\n> do\n> dirt=\"$dirt\n> hello\"\n> i=$(( i + 1 ))\n> done\n> \n> echo \"made dirt\"\n> \n> # suspend this process and wait for it to be resumed before checking that the\n> # data still exists.\n> #\n> # N.B.: posix sh doesn't have a suspend builtin, but we can make our own!\n> kill -s TSTP $$\n> \n> # check that the data is still correct.\n> #\n> # we do this by writing it out to a file and then looping through the file,\n> # because i wasn't sure how to loop over a variable line by line in posix sh\n> # without using a file.\n> dirtfile=\"/tmp/dirt.txt\"\n> echo \"$dirt\" > \"$dirtfile\"\n> actual_len=$(wc -l \"$dirtfile\" | cut -d \" \" -f 1)\n> echo \"found $actual_len lines of dirt\"\n> \n> # pre-check the file's length\n> if [ \"$actual_len\" -lt \"$len\" ]\n> then\n> echo \"not enough dirt: $actual_len < $len\"\n> exit 1\n> fi\n> \n> i=0\n> while read -r line\n> do\n> if [ $i -eq 8192 ]; then\n> echo \"all good\"\n> exit 0\n> fi\n> if [ \"$line\" != \"hello\" ]\n> then\n> echo \"bad dirt $i: $line\"\n> exit 1\n> fi\n> i=$(( i + 1 ))\n> done < \"$dirtfile\"\n> EOF","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17782024-03-22T05:07:52.939Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.738816429Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":104,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17792024-03-22T05:07:52.975Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.738938053Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17802024-03-22T05:07:52.975Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.738979925Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17812024-03-22T05:07:52.975Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.741351638Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":2,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17822024-03-22T05:07:52.975Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.741566324Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17832024-03-22T05:07:52.975Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.741647336Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"chmod +x dirt.sh","timeout_duration":"Explicit(15s)","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17842024-03-22T05:07:52.975Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.751875311Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":10,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17852024-03-22T05:07:52.975Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.752128809Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17862024-03-22T05:07:52.975Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.752212222Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17872024-03-22T05:07:53.018Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.774595711Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":22,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17882024-03-22T05:07:53.018Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.774734546Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17892024-03-22T05:07:53.018Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.774783607Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"./dirt.sh","timeout_duration":"Explicit(15s)","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17902024-03-22T05:07:53.018Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.785101295Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":10,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17912024-03-22T05:07:53.018Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.785347672Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17922024-03-22T05:07:53.018Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:52.785416155Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
17932024-03-22T05:07:53.319Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:53.117832681Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":332,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
17942024-03-22T05:07:53.346Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:53.117960345Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process::export_failure_target1","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
17952024-03-22T05:07:53.346Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:53.118046288Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"06f53b34-3c57-40d6-a485-51104e85a680","timeout_duration":"45s","target":"migrate_running_process::export_failure_target1","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
17962024-03-22T05:07:53.346Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:53.118159601Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_target1","target":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
17972024-03-22T05:07:53.441Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:53.240160158Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 8814b085-59bf-44de-98b2-4f59921458e9, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 808766b1-fb36-4142-b799-3db390a246aa, silo_id: edf974e2-5a62-4366-b1f8-899991ac81b2 }, name: \"phd-vm-8814b085-59bf-44de-98b2-4f59921458e9\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migrate_running_process::export_failure_target1","target":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
17982024-03-22T05:07:53.467Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:53.240263291Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::export_failure","target":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","elapsed_milliseconds":122,"source":"migrate_running_process::export_failure_source","vm":"migrate_running_process::export_failure_target1","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9"}
17992024-03-22T05:07:53.467Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:07:53.240314343Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process::export_failure_target1","migration_id":"06f53b34-3c57-40d6-a485-51104e85a680","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18002024-03-22T05:08:08.735Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Instance reported error during migration","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.535433594Z","target":"phd_framework::test_vm","line":537,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process::export_failure_target1","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18012024-03-22T05:08:08.762Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.535599649Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":15295,"target":"migrate_running_process::export_failure_target1","migration_id":"06f53b34-3c57-40d6-a485-51104e85a680","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18022024-03-22T05:08:08.762Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.535645401Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":15417,"target":"migrate_running_process::export_failure_target1","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18032024-03-22T05:08:08.762Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] first migration failed as expected","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.535699292Z","target":"phd_tests::migrate::running_process","line":206,"file":"phd-tests/tests/src/migrate.rs","error":"live migration","path":"phd_tests::migrate::running_process::export_failure"}
18042024-03-22T05:08:08.762Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.535750674Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process::export_failure_target2","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18052024-03-22T05:08:08.762Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.535791475Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"45s","migration_id":"2792db7a-bdef-4a3f-840b-306f9ae63a0d","target":"migrate_running_process::export_failure_target2","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18062024-03-22T05:08:08.762Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.535834106Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_target2","target":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18072024-03-22T05:08:08.846Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.645971368Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: f64423b9-394c-460a-80fe-2320bccc178c, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: aa097ff8-8dd1-43f5-a64b-d65fce0116b1, silo_id: 70a7cdb2-2455-4a45-a164-135193a78f2b }, name: \"phd-vm-f64423b9-394c-460a-80fe-2320bccc178c\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migrate_running_process::export_failure_target2","target":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18082024-03-22T05:08:08.872Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.646090492Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::export_failure","target":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","elapsed_milliseconds":110,"source":"migrate_running_process::export_failure_source","vm":"migrate_running_process::export_failure_target2","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c"}
18092024-03-22T05:08:08.872Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:08.646154264Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process::export_failure_target2","migration_id":"2792db7a-bdef-4a3f-840b-306f9ae63a0d","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18102024-03-22T05:08:20.290Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.09066676Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9004\",\"from_start\":9375}}"}
18112024-03-22T05:08:21.116Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.915879102Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process::export_failure_target2","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18122024-03-22T05:08:21.116Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.915937834Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":12269,"target":"migrate_running_process::export_failure_target2","migration_id":"2792db7a-bdef-4a3f-840b-306f9ae63a0d","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18132024-03-22T05:08:21.141Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.915982365Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":12380,"target":"migrate_running_process::export_failure_target2","source":"migrate_running_process::export_failure_source","source_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","target_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18142024-03-22T05:08:21.141Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.916120709Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18152024-03-22T05:08:21.141Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.916165021Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"fg","vm":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18162024-03-22T05:08:21.141Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.927607323Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":11,"vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","vm":"migrate_running_process::export_failure_target2","path":"phd_tests::migrate::running_process::export_failure"}
18172024-03-22T05:08:21.141Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.92784086Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18182024-03-22T05:08:21.142Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:20.927921133Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18192024-03-22T05:08:21.216Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.016350845Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":88,"vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","vm":"migrate_running_process::export_failure_target2","path":"phd_tests::migrate::running_process::export_failure"}
18202024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.016489819Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18212024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.016575292Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18222024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.016643994Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
18232024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.016767148Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
18242024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.01684137Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":32614}
18252024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::running_process::export_failure ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.01684193Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
18262024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.016918253Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
18272024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.017594113Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18282024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.017710327Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18292024-03-22T05:08:21.242Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.018030197Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm":"migrate_running_process::export_failure_source","vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","path":"phd_tests::migrate::running_process::export_failure"}
18302024-03-22T05:08:21.351Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.151107245Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":134,"vm_id":"7722ebad-7480-457c-a380-37a6b7b37cb3","vm":"migrate_running_process::export_failure_source","path":"phd_tests::migrate::running_process::export_failure"}
18312024-03-22T05:08:21.674Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.473179373Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9004","vm":"migrate_running_process::export_failure_target2","vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","path":"phd_tests::migrate::running_process::export_failure"}
18322024-03-22T05:08:21.796Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.595737767Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":579,"vm_id":"f64423b9-394c-460a-80fe-2320bccc178c","vm":"migrate_running_process::export_failure_target2","path":"phd_tests::migrate::running_process::export_failure"}
18332024-03-22T05:08:21.820Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.597107659Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18342024-03-22T05:08:21.948Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.734110798Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18352024-03-22T05:08:21.983Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.734222072Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-d899aff6-1bb4-4fb7-8b13-d262a2601934\"]","verb":"destroy","vm":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18362024-03-22T05:08:21.983Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.771382336Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18372024-03-22T05:08:21.983Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.771437398Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-b259c9d2-8e24-4eb3-8582-d81573462942\"]","verb":"destroy","vm":"migrate_running_process::export_failure_target1","vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","path":"phd_tests::migrate::running_process::export_failure"}
18382024-03-22T05:08:22.012Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.793380274Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":776,"vm_id":"8814b085-59bf-44de-98b2-4f59921458e9","vm":"migrate_running_process::export_failure_target1","path":"phd_tests::migrate::running_process::export_failure"}
18392024-03-22T05:08:22.012Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.793449886Z","target":"phd_tests::migrate::running_process","line":172,"file":"phd-tests/tests/src/migrate.rs","elapsed_milliseconds":33620,"path":"phd_tests::migrate::running_process::export_failure"}
18402024-03-22T05:08:22.012Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.793623261Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":776}
18412024-03-22T05:08:22.012Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::running_process::import_failure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.793682023Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
18422024-03-22T05:08:22.012Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.793715704Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
18432024-03-22T05:08:22.012Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.793743495Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
18442024-03-22T05:08:22.013Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.793863249Z","target":"phd_tests::migrate::running_process","line":120,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::running_process::import_failure"}
18452024-03-22T05:08:22.013Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.793951171Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::running_process::import_failure"}
18462024-03-22T05:08:22.013Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.794136407Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::running_process::import_failure"}
18472024-03-22T05:08:22.013Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.794188888Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::running_process::import_failure"}
18482024-03-22T05:08:22.013Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.79423566Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","verb":"list","path":"phd_tests::migrate::running_process::import_failure"}
18492024-03-22T05:08:22.013Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.809417588Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 767M 1.80T 765M /phd-artifacts\n","path":"phd_tests::migrate::running_process::import_failure"}
18502024-03-22T05:08:22.013Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.809563012Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-b8936745-2146-44aa-8ad0-664056ca970f\"]","path":"phd_tests::migrate::running_process::import_failure"}
18512024-03-22T05:08:22.039Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.828873287Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-b8936745-2146-44aa-8ad0-664056ca970f\", \"phd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446\"]","verb":"clone","path":"phd_tests::migrate::running_process::import_failure"}
18522024-03-22T05:08:22.065Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.848750389Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446\"]","verb":"list","path":"phd_tests::migrate::running_process::import_failure"}
18532024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.863944347Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446 0B 1.80T 765M /phd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446\n","path":"phd_tests::migrate::running_process::import_failure"}
18542024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.864595917Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure"}
18552024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.864677789Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"migrate_running_process::import_failure_source","guest_os_kind":"Alpine","path":"phd_tests::migrate::running_process::import_failure"}
18562024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.864744661Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::running_process::import_failure"}
18572024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.864812294Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_source.config.toml\"","server_addr":"127.0.0.1:9000","path":"phd_tests::migrate::running_process::import_failure"}
18582024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.864854755Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_source.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_source.stdout.log\"","path":"phd_tests::migrate::running_process::import_failure"}
18592024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1059","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.874233304Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::running_process::import_failure"}
18602024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.874738109Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":10}
18612024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.874878793Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::running_process::import_failure"}
18622024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.875050199Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::running_process::import_failure"}
18632024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.87509577Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::running_process::import_failure"}
18642024-03-22T05:08:22.109Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.875136931Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::running_process::import_failure"}
18652024-03-22T05:08:22.136Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.890591047Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 766M 1.80T 765M /phd-artifacts\n","path":"phd_tests::migrate::running_process::import_failure"}
18662024-03-22T05:08:22.136Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.89066111Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-4909960c-728b-4ffe-9232-2e7bc58ce31d\"]","path":"phd_tests::migrate::running_process::import_failure"}
18672024-03-22T05:08:22.136Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.911161701Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-4909960c-728b-4ffe-9232-2e7bc58ce31d\", \"phd-artifacts/phd-clone-5e80e962-f5c4-42dc-8657-dde4800f011c\"]","path":"phd_tests::migrate::running_process::import_failure"}
18682024-03-22T05:08:22.136Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.931456436Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-5e80e962-f5c4-42dc-8657-dde4800f011c\"]","verb":"list","path":"phd_tests::migrate::running_process::import_failure"}
18692024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.946715776Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-5e80e962-f5c4-42dc-8657-dde4800f011c 0B 1.80T 765M /phd-artifacts/phd-clone-5e80e962-f5c4-42dc-8657-dde4800f011c\n","path":"phd_tests::migrate::running_process::import_failure"}
18702024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.947411467Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure"}
18712024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.947549391Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","vm_name":"migrate_running_process::import_failure_target1","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-5e80e962-f5c4-42dc-8657-dde4800f011c/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::migrate::running_process::import_failure"}
18722024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.947631564Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::running_process::import_failure"}
18732024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.947697566Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9002","config_toml_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_target1.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::migrate::running_process::import_failure"}
18742024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.947739837Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_target1.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_target1.stderr.log\"","path":"phd_tests::migrate::running_process::import_failure"}
18752024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1064","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.956877989Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::running_process::import_failure"}
18762024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.957447516Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":9}
18772024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.95758104Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure"}
18782024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.957649152Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_name":"migrate_running_process::import_failure_target2","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::migrate::running_process::import_failure"}
18792024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.957708284Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::running_process::import_failure"}
18802024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.957767186Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9004","config_toml_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_target2.config.toml\"","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::migrate::running_process::import_failure"}
18812024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.957804987Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_target2.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migrate_running_process::import_failure_target2.stdout.log\"","path":"phd_tests::migrate::running_process::import_failure"}
18822024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1065","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.96638262Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::running_process::import_failure"}
18832024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.96669281Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":9}
18842024-03-22T05:08:22.174Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:21.966767262Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
18852024-03-22T05:08:22.288Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.087712537Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
18862024-03-22T05:08:22.313Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.088864242Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 13d19c10-efaf-4112-b99b-6ad9630cb131, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 4c25e1cc-bb6e-4389-9737-cec4765ae8f4, silo_id: f53dc32d-162a-459d-ab50-ac051bfaae09 }, name: \"phd-vm-13d19c10-efaf-4112-b99b-6ad9630cb131\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
18872024-03-22T05:08:22.313Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.088973925Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":122,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
18882024-03-22T05:08:22.313Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.089050268Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
18892024-03-22T05:08:22.313Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.089088109Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
18902024-03-22T05:08:22.313Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.089699278Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":0,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
18912024-03-22T05:08:22.313Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.08975629Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure"}
18922024-03-22T05:08:22.313Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.089799141Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source","timeout_duration":"300s","path":"phd_tests::migrate::running_process::import_failure"}
18932024-03-22T05:08:22.314Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.089833652Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::running_process::import_failure"}
18942024-03-22T05:08:22.314Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.089867023Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
18952024-03-22T05:08:22.314Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:22.089899244Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
18962024-03-22T05:08:26.520Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.320572034Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":4230,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
18972024-03-22T05:08:26.521Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.320646857Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::running_process::import_failure"}
18982024-03-22T05:08:26.573Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.320821632Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::running_process::import_failure"}
18992024-03-22T05:08:26.573Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.320870844Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19002024-03-22T05:08:26.573Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.320904505Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost:~#","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19012024-03-22T05:08:26.573Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.340796187Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":19,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
19022024-03-22T05:08:26.573Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.34087869Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure"}
19032024-03-22T05:08:26.574Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.340909901Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":4251}
19042024-03-22T05:08:26.574Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.341109197Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19052024-03-22T05:08:26.574Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.341153768Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"cat >dirt.sh <<'EOF'\n> #!/usr/bin/env sh\n> # a simple script for testing migration of running process memory.\n> #\n> # this script will write a bunch of \"hello\"s to an in-memory string, then\n> # suspend to wait for a migration to occur. after the migration happens, the\n> # script can be foregrounded, and it will then check that the data is still\n> # there.\n> dirt=\"hello\"\n> len=8192 # 8 KiB ought to be enough for anyone\n> \n> # store 8k of data in memory\n> i=0\n> while [ \"$i\" -lt \"$len\" ]\n> do\n> dirt=\"$dirt\n> hello\"\n> i=$(( i + 1 ))\n> done\n> \n> echo \"made dirt\"\n> \n> # suspend this process and wait for it to be resumed before checking that the\n> # data still exists.\n> #\n> # N.B.: posix sh doesn't have a suspend builtin, but we can make our own!\n> kill -s TSTP $$\n> \n> # check that the data is still correct.\n> #\n> # we do this by writing it out to a file and then looping through the file,\n> # because i wasn't sure how to loop over a variable line by line in posix sh\n> # without using a file.\n> dirtfile=\"/tmp/dirt.txt\"\n> echo \"$dirt\" > \"$dirtfile\"\n> actual_len=$(wc -l \"$dirtfile\" | cut -d \" \" -f 1)\n> echo \"found $actual_len lines of dirt\"\n> \n> # pre-check the file's length\n> if [ \"$actual_len\" -lt \"$len\" ]\n> then\n> echo \"not enough dirt: $actual_len < $len\"\n> exit 1\n> fi\n> \n> i=0\n> while read -r line\n> do\n> if [ $i -eq 8192 ]; then\n> echo \"all good\"\n> exit 0\n> fi\n> if [ \"$line\" != \"hello\" ]\n> then\n> echo \"bad dirt $i: $line\"\n> exit 1\n> fi\n> i=$(( i + 1 ))\n> done < \"$dirtfile\"\n> EOF","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19062024-03-22T05:08:26.651Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.449945459Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":108,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
19072024-03-22T05:08:26.685Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.450062102Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19082024-03-22T05:08:26.685Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.450103603Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19092024-03-22T05:08:26.686Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.459700829Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":9,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
19102024-03-22T05:08:26.686Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.460130802Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19112024-03-22T05:08:26.686Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.460187254Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"chmod +x dirt.sh","timeout_duration":"Explicit(15s)","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19122024-03-22T05:08:26.686Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.4714352Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":11,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
19132024-03-22T05:08:26.686Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.471656497Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19142024-03-22T05:08:26.686Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.47173769Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19152024-03-22T05:08:26.724Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.5042021Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":32,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
19162024-03-22T05:08:26.724Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.504333264Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19172024-03-22T05:08:26.724Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.504383565Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"./dirt.sh","timeout_duration":"Explicit(15s)","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19182024-03-22T05:08:26.724Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.514673762Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":10,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
19192024-03-22T05:08:26.724Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.514916839Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19202024-03-22T05:08:26.725Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.514998662Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19212024-03-22T05:08:27.022Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.822206032Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":307,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
19222024-03-22T05:08:27.047Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.822334956Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1"}
19232024-03-22T05:08:27.047Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.822414009Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"80d2317c-6ff9-4b48-a5b7-744b429a4d5e","timeout_duration":"45s","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1"}
19242024-03-22T05:08:27.047Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.822492271Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::import_failure_target1","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1"}
19252024-03-22T05:08:27.140Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.939745722Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 55611a7e-db1a-4876-999b-476954f29cdd, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 7a68e825-af40-4979-9205-a7d10982a849, silo_id: b8f3de00-6a39-48b8-8105-b0f39f475405 }, name: \"phd-vm-55611a7e-db1a-4876-999b-476954f29cdd\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-5e80e962-f5c4-42dc-8657-dde4800f011c/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migrate_running_process::import_failure_target1","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1"}
19262024-03-22T05:08:27.165Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.939851975Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":117,"vm_id":"55611a7e-db1a-4876-999b-476954f29cdd","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","vm":"migrate_running_process::import_failure_target1","source":"migrate_running_process::import_failure_source"}
19272024-03-22T05:08:27.165Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:26.939903257Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","migration_id":"80d2317c-6ff9-4b48-a5b7-744b429a4d5e","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1"}
19282024-03-22T05:08:41.574Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Instance reported error during migration","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.373138469Z","target":"phd_framework::test_vm","line":537,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1"}
19292024-03-22T05:08:41.600Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.373311225Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","migration_id":"80d2317c-6ff9-4b48-a5b7-744b429a4d5e","elapsed_milliseconds":14433,"source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1"}
19302024-03-22T05:08:41.600Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.373359026Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"55611a7e-db1a-4876-999b-476954f29cdd","elapsed_milliseconds":14550,"source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target1"}
19312024-03-22T05:08:41.600Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] first migration failed as expected","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.373412708Z","target":"phd_tests::migrate::running_process","line":162,"file":"phd-tests/tests/src/migrate.rs","error":"live migration","path":"phd_tests::migrate::running_process::import_failure"}
19322024-03-22T05:08:41.600Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.373467569Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2"}
19332024-03-22T05:08:41.600Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.373509631Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"45s","migration_id":"f42e00e5-9b3a-47af-afab-ef71e015af4e","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2"}
19342024-03-22T05:08:41.600Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.373551962Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migrate_running_process::import_failure_target2","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2"}
19352024-03-22T05:08:41.697Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.496745246Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: b6118ccd-58d3-4183-a630-f77c4e2ba65d, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: b1803f1b-f89f-4aa7-a65c-766bf5bd8dcf, silo_id: 02f215f5-6d03-4b13-8f56-79a9349734a8 }, name: \"phd-vm-b6118ccd-58d3-4183-a630-f77c4e2ba65d\", vcpus: 2 }, state: Migrating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm":"migrate_running_process::import_failure_target2","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2"}
19362024-03-22T05:08:41.722Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.496849159Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":123,"vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","vm":"migrate_running_process::import_failure_target2","source":"migrate_running_process::import_failure_source"}
19372024-03-22T05:08:41.722Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:41.49689802Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","migration_id":"f42e00e5-9b3a-47af-afab-ef71e015af4e","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2"}
19382024-03-22T05:08:53.126Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:52.926397984Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9004\",\"from_start\":9375}}"}
19392024-03-22T05:08:53.457Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.256450237Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2"}
19402024-03-22T05:08:53.457Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.256501438Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","migration_id":"f42e00e5-9b3a-47af-afab-ef71e015af4e","elapsed_milliseconds":11759,"source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2"}
19412024-03-22T05:08:53.487Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.25654415Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","target_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","elapsed_milliseconds":11883,"source":"migrate_running_process::import_failure_source","source_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","target":"migrate_running_process::import_failure_target2"}
19422024-03-22T05:08:53.487Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.256688574Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19432024-03-22T05:08:53.487Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.256737416Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"fg","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19442024-03-22T05:08:53.487Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.268373374Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":11,"vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","vm":"migrate_running_process::import_failure_target2"}
19452024-03-22T05:08:53.487Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.268661663Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19462024-03-22T05:08:53.487Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.268749536Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19472024-03-22T05:08:53.557Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.357113657Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":88,"vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","vm":"migrate_running_process::import_failure_target2"}
19482024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.357262321Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19492024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.357402015Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target1","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd"}
19502024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.35753754Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19512024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.357774897Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
19522024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::running_process::import_failure ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.35788683Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
19532024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.357949943Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":31270}
19542024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.358021425Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
19552024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.358385396Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19562024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.358746317Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_source","vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131"}
19572024-03-22T05:08:53.585Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.358749507Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target1","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd"}
19582024-03-22T05:08:53.696Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.496183929Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":138,"vm_id":"13d19c10-efaf-4112-b99b-6ad9630cb131","vm":"migrate_running_process::import_failure_source"}
19592024-03-22T05:08:54.157Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:53.957236567Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9004","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19602024-03-22T05:08:54.295Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.09438184Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19612024-03-22T05:08:54.328Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.094455792Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-76462f70-6129-4ecd-933b-23989fb8c446\"]","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19622024-03-22T05:08:54.353Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.130492022Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19632024-03-22T05:08:54.353Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.130549744Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-b8936745-2146-44aa-8ad0-664056ca970f\"]","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target2","vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d"}
19642024-03-22T05:08:54.383Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.157544115Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":800,"vm_id":"b6118ccd-58d3-4183-a630-f77c4e2ba65d","vm":"migrate_running_process::import_failure_target2"}
19652024-03-22T05:08:54.384Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.158662909Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target1","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd"}
19662024-03-22T05:08:54.494Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.293963626Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target1","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd"}
19672024-03-22T05:08:54.519Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.294057229Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-5e80e962-f5c4-42dc-8657-dde4800f011c\"]","verb":"destroy","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target1","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd"}
19682024-03-22T05:08:54.544Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.32722869Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target1","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd"}
19692024-03-22T05:08:54.544Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.327281032Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-4909960c-728b-4ffe-9232-2e7bc58ce31d\"]","path":"phd_tests::migrate::running_process::import_failure","vm":"migrate_running_process::import_failure_target1","vm_id":"55611a7e-db1a-4876-999b-476954f29cdd"}
19702024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.350406884Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":992,"vm_id":"55611a7e-db1a-4876-999b-476954f29cdd","vm":"migrate_running_process::import_failure_target1"}
19712024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.350471586Z","target":"phd_tests::migrate::running_process","line":120,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::running_process::import_failure","elapsed_milliseconds":32556}
19722024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.350654972Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":992}
19732024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::running_process::migrate_running_process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.350735364Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
19742024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.350770085Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
19752024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.350797966Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
19762024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.35092228Z","target":"phd_tests::migrate::running_process","line":100,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::running_process::migrate_running_process"}
19772024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.350999472Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::running_process::migrate_running_process"}
19782024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.351165048Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::running_process::migrate_running_process"}
19792024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.351218039Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::running_process::migrate_running_process"}
19802024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.35126242Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","verb":"list","path":"phd_tests::migrate::running_process::migrate_running_process"}
19812024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.366704516Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 766M 1.80T 765M /phd-artifacts\n","path":"phd_tests::migrate::running_process::migrate_running_process"}
19822024-03-22T05:08:54.570Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.366799989Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-1914a0b9-8e24-46c4-9960-07bf643309c7\"]","path":"phd_tests::migrate::running_process::migrate_running_process"}
19832024-03-22T05:08:54.595Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.385061061Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-1914a0b9-8e24-46c4-9960-07bf643309c7\", \"phd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73\"]","verb":"clone","path":"phd_tests::migrate::running_process::migrate_running_process"}
19842024-03-22T05:08:54.624Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.406345037Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73\"]","verb":"list","path":"phd_tests::migrate::running_process::migrate_running_process"}
19852024-03-22T05:08:54.624Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.420054049Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73 0B 1.80T 765M /phd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73\n","path":"phd_tests::migrate::running_process::migrate_running_process"}
19862024-03-22T05:08:54.624Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.420575315Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process"}
19872024-03-22T05:08:54.624Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.420665588Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"migrate_running_process_source","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","path":"phd_tests::migrate::running_process::migrate_running_process"}
19882024-03-22T05:08:54.624Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.42074324Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::running_process::migrate_running_process"}
19892024-03-22T05:08:54.624Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.420818762Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/migrate_running_process_source.config.toml\"","server_addr":"127.0.0.1:9000","path":"phd_tests::migrate::running_process::migrate_running_process"}
19902024-03-22T05:08:54.650Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.420864034Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migrate_running_process_source.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migrate_running_process_source.stdout.log\"","path":"phd_tests::migrate::running_process::migrate_running_process"}
19912024-03-22T05:08:54.650Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1077","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.429438468Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::running_process::migrate_running_process"}
19922024-03-22T05:08:54.650Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.429811099Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":9,"path":"phd_tests::migrate::running_process::migrate_running_process"}
19932024-03-22T05:08:54.650Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.429902602Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process"}
19942024-03-22T05:08:54.650Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.429962904Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","guest_os_kind":"Alpine","vm_name":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process"}
19952024-03-22T05:08:54.650Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.430021536Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::running_process::migrate_running_process"}
19962024-03-22T05:08:54.650Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.430075838Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9002","config_toml_path":"\"/tmp/propolis-phd/migrate_running_process_target.config.toml\"","path":"phd_tests::migrate::running_process::migrate_running_process"}
19972024-03-22T05:08:54.651Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.430112549Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migrate_running_process_target.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migrate_running_process_target.stderr.log\"","path":"phd_tests::migrate::running_process::migrate_running_process"}
19982024-03-22T05:08:54.651Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1078","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.43957951Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::running_process::migrate_running_process"}
19992024-03-22T05:08:54.651Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.43990553Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":9,"path":"phd_tests::migrate::running_process::migrate_running_process"}
20002024-03-22T05:08:54.651Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.439985313Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20012024-03-22T05:08:54.651Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:54.440521109Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20022024-03-22T05:08:55.437Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.237293285Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
20032024-03-22T05:08:55.484Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.237886623Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: eb2d94dd-9d56-446b-81ad-97463ca03e5d, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 2838e15c-3554-4793-a81e-51ec1ebe7569, silo_id: f870d5f6-0f6d-47ab-a5f5-9497e7295359 }, name: \"phd-vm-eb2d94dd-9d56-446b-81ad-97463ca03e5d\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20042024-03-22T05:08:55.484Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.237969416Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":797}
20052024-03-22T05:08:55.485Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.238036518Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20062024-03-22T05:08:55.485Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.238074109Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20072024-03-22T05:08:55.485Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.23909136Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":1}
20082024-03-22T05:08:55.485Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.239145442Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process"}
20092024-03-22T05:08:55.485Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.239186153Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","vm":"migrate_running_process_source","timeout_duration":"300s","path":"phd_tests::migrate::running_process::migrate_running_process"}
20102024-03-22T05:08:55.485Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.239219514Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::running_process::migrate_running_process"}
20112024-03-22T05:08:55.485Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.239251815Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20122024-03-22T05:08:55.485Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:55.239284996Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20132024-03-22T05:08:59.710Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.509900217Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":4270}
20142024-03-22T05:08:59.710Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.50998289Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::running_process::migrate_running_process"}
20152024-03-22T05:08:59.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.510155195Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::running_process::migrate_running_process"}
20162024-03-22T05:08:59.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.510206026Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20172024-03-22T05:08:59.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.510240527Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost:~#","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20182024-03-22T05:08:59.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.529827141Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":19}
20192024-03-22T05:08:59.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.529909833Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process"}
20202024-03-22T05:08:59.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.529941774Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4290,"path":"phd_tests::migrate::running_process::migrate_running_process"}
20212024-03-22T05:08:59.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.53012154Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20222024-03-22T05:08:59.762Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.530165701Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"cat >dirt.sh <<'EOF'\n> #!/usr/bin/env sh\n> # a simple script for testing migration of running process memory.\n> #\n> # this script will write a bunch of \"hello\"s to an in-memory string, then\n> # suspend to wait for a migration to occur. after the migration happens, the\n> # script can be foregrounded, and it will then check that the data is still\n> # there.\n> dirt=\"hello\"\n> len=8192 # 8 KiB ought to be enough for anyone\n> \n> # store 8k of data in memory\n> i=0\n> while [ \"$i\" -lt \"$len\" ]\n> do\n> dirt=\"$dirt\n> hello\"\n> i=$(( i + 1 ))\n> done\n> \n> echo \"made dirt\"\n> \n> # suspend this process and wait for it to be resumed before checking that the\n> # data still exists.\n> #\n> # N.B.: posix sh doesn't have a suspend builtin, but we can make our own!\n> kill -s TSTP $$\n> \n> # check that the data is still correct.\n> #\n> # we do this by writing it out to a file and then looping through the file,\n> # because i wasn't sure how to loop over a variable line by line in posix sh\n> # without using a file.\n> dirtfile=\"/tmp/dirt.txt\"\n> echo \"$dirt\" > \"$dirtfile\"\n> actual_len=$(wc -l \"$dirtfile\" | cut -d \" \" -f 1)\n> echo \"found $actual_len lines of dirt\"\n> \n> # pre-check the file's length\n> if [ \"$actual_len\" -lt \"$len\" ]\n> then\n> echo \"not enough dirt: $actual_len < $len\"\n> exit 1\n> fi\n> \n> i=0\n> while read -r line\n> do\n> if [ $i -eq 8192 ]; then\n> echo \"all good\"\n> exit 0\n> fi\n> if [ \"$line\" != \"hello\" ]\n> then\n> echo \"bad dirt $i: $line\"\n> exit 1\n> fi\n> i=$(( i + 1 ))\n> done < \"$dirtfile\"\n> EOF","timeout_duration":"Explicit(15s)","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20232024-03-22T05:08:59.833Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.633804583Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":103}
20242024-03-22T05:08:59.860Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.633916576Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20252024-03-22T05:08:59.860Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.633956537Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20262024-03-22T05:08:59.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.636273559Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":2}
20272024-03-22T05:08:59.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.636401463Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20282024-03-22T05:08:59.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.636449504Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"chmod +x dirt.sh","timeout_duration":"Explicit(15s)","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20292024-03-22T05:08:59.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.64670507Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":10}
20302024-03-22T05:08:59.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.646856674Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20312024-03-22T05:08:59.861Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.646909086Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20322024-03-22T05:08:59.886Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.669229254Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":22}
20332024-03-22T05:08:59.886Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.669362978Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20342024-03-22T05:08:59.886Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.669413449Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"./dirt.sh","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20352024-03-22T05:08:59.886Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.679688496Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":10}
20362024-03-22T05:08:59.886Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.679878731Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20372024-03-22T05:08:59.887Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.679949814Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20382024-03-22T05:09:00.192Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.992465697Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":312}
20392024-03-22T05:09:00.217Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.99254554Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20402024-03-22T05:09:00.217Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.992596141Z","target":"phd_framework::test_vm","line":504,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"b412866e-fb4f-427a-b102-736289c74d09","timeout_duration":"45s","target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20412024-03-22T05:09:00.217Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:08:59.992649903Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20422024-03-22T05:09:00.306Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:00.106183239Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": File(FileStorageBackend { path: \"/phd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\", readonly: false })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: 37ce7ecd-f041-4bee-8635-2d6630be11b1, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: 88cfdda3-799d-4e39-bcdd-98f7be2ca23e, silo_id: 13bd2367-4a00-46e6-8573-7ddbc5b63224 }, name: \"phd-vm-37ce7ecd-f041-4bee-8635-2d6630be11b1\", vcpus: 2 }, state: Migrating }","target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20432024-03-22T05:09:00.332Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:00.106293903Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":113,"target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20442024-03-22T05:09:00.332Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:00.106352244Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","migration_id":"b412866e-fb4f-427a-b102-736289c74d09","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20452024-03-22T05:09:11.751Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial socket control message","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:11.551061256Z","target":"phd_framework::serial","line":275,"file":"phd-tests/framework/src/serial/mod.rs","s":"{\"Migrating\":{\"destination\":\"127.0.0.1:9002\",\"from_start\":9375}}"}
20462024-03-22T05:09:18.159Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migration completed successfully","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:17.959335435Z","target":"phd_framework::test_vm","line":533,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20472024-03-22T05:09:18.159Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:17.959400447Z","target":"phd_framework::test_vm","line":524,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","migration_id":"b412866e-fb4f-427a-b102-736289c74d09","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","elapsed_milliseconds":17853,"source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20482024-03-22T05:09:18.184Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:17.959448459Z","target":"phd_framework::test_vm","line":471,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"migrate_running_process_target","path":"phd_tests::migrate::running_process::migrate_running_process","source":"migrate_running_process_source","target_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","elapsed_milliseconds":17966,"source_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d"}
20492024-03-22T05:09:18.184Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:17.959621954Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20502024-03-22T05:09:18.185Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:17.959668336Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"fg","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20512024-03-22T05:09:18.185Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:17.971247222Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","elapsed_milliseconds":11}
20522024-03-22T05:09:18.185Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:17.971378936Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20532024-03-22T05:09:18.185Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:17.971429007Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20542024-03-22T05:09:18.258Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.058741916Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","elapsed_milliseconds":87}
20552024-03-22T05:09:18.283Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.058838659Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20562024-03-22T05:09:18.284Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.058961903Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20572024-03-22T05:09:18.284Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.05918403Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
20582024-03-22T05:09:18.284Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.059324124Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":22821}
20592024-03-22T05:09:18.284Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::running_process::migrate_running_process ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.059310074Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
20602024-03-22T05:09:18.284Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.059438728Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
20612024-03-22T05:09:18.284Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.060392897Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20622024-03-22T05:09:18.284Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.060740558Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source"}
20632024-03-22T05:09:18.396Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.196102876Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_source","vm_id":"eb2d94dd-9d56-446b-81ad-97463ca03e5d","elapsed_milliseconds":136}
20642024-03-22T05:09:18.430Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.19720032Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20652024-03-22T05:09:18.530Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.330254337Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20662024-03-22T05:09:18.530Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.330317519Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts/phd-clone-08e3c0ed-e6e0-4e27-89a6-76156d18aa73\"]","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20672024-03-22T05:09:18.569Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.367543436Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20682024-03-22T05:09:18.595Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.367597378Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-1914a0b9-8e24-46c4-9960-07bf643309c7\"]","verb":"destroy","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target"}
20692024-03-22T05:09:18.595Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.391824044Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::running_process::migrate_running_process","vm":"migrate_running_process_target","vm_id":"37ce7ecd-f041-4bee-8635-2d6630be11b1","elapsed_milliseconds":332}
20702024-03-22T05:09:18.595Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.391881135Z","target":"phd_tests::migrate::running_process","line":100,"file":"phd-tests/tests/src/migrate.rs","elapsed_milliseconds":24040,"path":"phd_tests::migrate::running_process::migrate_running_process"}
20712024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392138793Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":332}
20722024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::crucible::smoke::shutdown_persistence_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392225566Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
20732024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392261217Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
20742024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392288318Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
20752024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392414332Z","target":"phd_tests::crucible::smoke","line":19,"file":"phd-tests/tests/src/crucible/smoke.rs","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20762024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392520325Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20772024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392711921Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20782024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392773113Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/befb56700b5f07b1c345aa2fe36100e547820aa6aac67a259f58a8651b489594/crucible-downstairs","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20792024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392815364Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20802024-03-22T05:09:18.596Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.392911577Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9000\", \"--encrypted\", \"--uuid\", \"ee7b096f-0ea5-42be-a529-065fbb00c587\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20812024-03-22T05:09:18.656Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.456891957Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9000/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.415831423Z\",\"hostname\":\"buskin\",\"pid\":1083}\n{\"msg\":\"UUID: ee7b096f-0ea5-42be-a529-065fbb00c587\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.448549891Z\",\"hostname\":\"buskin\",\"pid\":1083}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.448561071Z\",\"hostname\":\"buskin\",\"pid\":1083}\n","stderr":"","status":"ExitStatus(unix_wait_status(0))","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20822024-03-22T05:09:18.681Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.457001051Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9001\", \"--encrypted\", \"--uuid\", \"ee7b096f-0ea5-42be-a529-065fbb00c587\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20832024-03-22T05:09:18.722Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.521674722Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","status":"ExitStatus(unix_wait_status(0))","stderr":"","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9001/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.480575387Z\",\"hostname\":\"buskin\",\"pid\":1084}\n{\"msg\":\"UUID: ee7b096f-0ea5-42be-a529-065fbb00c587\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.513434669Z\",\"hostname\":\"buskin\",\"pid\":1084}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.513452879Z\",\"hostname\":\"buskin\",\"pid\":1084}\n","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20842024-03-22T05:09:18.746Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.521780975Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9002\", \"--encrypted\", \"--uuid\", \"ee7b096f-0ea5-42be-a529-065fbb00c587\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20852024-03-22T05:09:18.787Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.585874199Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9002/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.544463304Z\",\"hostname\":\"buskin\",\"pid\":1085}\n{\"msg\":\"UUID: ee7b096f-0ea5-42be-a529-065fbb00c587\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.577482511Z\",\"hostname\":\"buskin\",\"pid\":1085}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.577495821Z\",\"hostname\":\"buskin\",\"pid\":1085}\n","status":"ExitStatus(unix_wait_status(0))","stderr":"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20862024-03-22T05:09:18.813Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.586003703Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9000.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9000.stderr.log\"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20872024-03-22T05:09:18.813Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.586080266Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9000\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9000\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20882024-03-22T05:09:18.813Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.586127337Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9000\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9000\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20892024-03-22T05:09:18.813Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.596321921Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9001.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9001.stderr.log\"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20902024-03-22T05:09:18.814Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.596410434Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9001\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9001\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20912024-03-22T05:09:18.814Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.596450775Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9001\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9001\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20922024-03-22T05:09:18.814Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.60472401Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9002.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9002.stderr.log\"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20932024-03-22T05:09:18.814Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.604790502Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9002\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9002\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20942024-03-22T05:09:18.814Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.604822513Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9002\", \"--data\", \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9002\"]","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20952024-03-22T05:09:18.839Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.615050698Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20962024-03-22T05:09:18.839Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.615169842Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"crucible_shutdown_persistence_test","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"ee7b096f-0ea5-42be-a529-065fbb00c587\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"e4f4d075-8fd3-41eb-9627-27e95a488b5b\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":1,\\\"opts\\\":{\\\"id\\\":\\\"2a78aa4f-9d5d-4d26-867e-6186949c8022\\\",\\\"key\\\":\\\"Y26nHXmjhMPXajm1GBwB9079eyunwdT/tuY/5RVrAZI=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","guest_os_kind":"Alpine","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20972024-03-22T05:09:18.840Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.615273385Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20982024-03-22T05:09:18.840Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.615357237Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","config_toml_path":"\"/tmp/propolis-phd/crucible_shutdown_persistence_test.config.toml\"","server_addr":"127.0.0.1:9003","server_path":"\"/work/phd-test/propolis-server\"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
20992024-03-22T05:09:18.840Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.615405619Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_shutdown_persistence_test.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_shutdown_persistence_test.stderr.log\"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21002024-03-22T05:09:18.840Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1089","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.626766799Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21012024-03-22T05:09:18.840Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.627161451Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::shutdown_persistence_test","elapsed_milliseconds":12}
21022024-03-22T05:09:18.840Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.62747258Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9003","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21032024-03-22T05:09:18.865Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.645510046Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9000\" } }","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21042024-03-22T05:09:18.865Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.655500104Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9000\"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21052024-03-22T05:09:18.865Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.662915472Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9001\" } }","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21062024-03-22T05:09:18.890Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.672032173Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9001\"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21072024-03-22T05:09:18.890Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.679458931Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: \"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9002\" } }","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21082024-03-22T05:09:18.890Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.688762948Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/ee7b096f-0ea5-42be-a529-065fbb00c587_9002\"","path":"phd_tests::crucible::smoke::shutdown_persistence_test"}
21092024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696094483Z","target":"phd_tests::crucible::smoke","line":19,"file":"phd-tests/tests/src/crucible/smoke.rs","path":"phd_tests::crucible::smoke::shutdown_persistence_test","elapsed_milliseconds":303}
21102024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"test phd_tests::crucible::smoke::shutdown_persistence_test ... skipped: Can't run data persistence test on a guest with a read-only file\n system","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.69632101Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
21112024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696390903Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
21122024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696453175Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
21132024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::crucible::smoke::boot_test","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696500156Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
21142024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696533787Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
21152024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696565618Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
21162024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696683242Z","target":"phd_tests::crucible::smoke","line":10,"file":"phd-tests/tests/src/crucible/smoke.rs","path":"phd_tests::crucible::smoke::boot_test"}
21172024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696747664Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::crucible::smoke::boot_test"}
21182024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696908439Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::crucible::smoke::boot_test"}
21192024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.6969585Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/befb56700b5f07b1c345aa2fe36100e547820aa6aac67a259f58a8651b489594/crucible-downstairs","path":"phd_tests::crucible::smoke::boot_test"}
21202024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.696990741Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::crucible::smoke::boot_test"}
21212024-03-22T05:09:18.916Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.697072324Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000\", \"--encrypted\", \"--uuid\", \"ccc6d4ce-52c4-4e65-91d2-293feca91fa9\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::smoke::boot_test"}
21222024-03-22T05:09:18.963Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.75929979Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","stderr":"","status":"ExitStatus(unix_wait_status(0))","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.718363349Z\",\"hostname\":\"buskin\",\"pid\":1091}\n{\"msg\":\"UUID: ccc6d4ce-52c4-4e65-91d2-293feca91fa9\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.751255212Z\",\"hostname\":\"buskin\",\"pid\":1091}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.751266793Z\",\"hostname\":\"buskin\",\"pid\":1091}\n","path":"phd_tests::crucible::smoke::boot_test"}
21232024-03-22T05:09:18.994Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.759406783Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001\", \"--encrypted\", \"--uuid\", \"ccc6d4ce-52c4-4e65-91d2-293feca91fa9\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::smoke::boot_test"}
21242024-03-22T05:09:19.022Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.821399952Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.779804641Z\",\"hostname\":\"buskin\",\"pid\":1092}\n{\"msg\":\"UUID: ccc6d4ce-52c4-4e65-91d2-293feca91fa9\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.813056355Z\",\"hostname\":\"buskin\",\"pid\":1092}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.813067696Z\",\"hostname\":\"buskin\",\"pid\":1092}\n","stderr":"","status":"ExitStatus(unix_wait_status(0))","path":"phd_tests::crucible::smoke::boot_test"}
21252024-03-22T05:09:19.047Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.821507866Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"create\", \"--block-size\", \"512\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002\", \"--encrypted\", \"--uuid\", \"ccc6d4ce-52c4-4e65-91d2-293feca91fa9\", \"--extent-size\", \"131072\", \"--extent-count\", \"160\"]","path":"phd_tests::crucible::smoke::boot_test"}
21262024-03-22T05:09:19.082Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Created Crucible region using crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.881591536Z","target":"phd_framework::disk::crucible","line":202,"file":"phd-tests/framework/src/disk/crucible.rs","stdout":"{\"msg\":\"Created new region file \\\"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002/region.json\\\"\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.841215512Z\",\"hostname\":\"buskin\",\"pid\":1093}\n{\"msg\":\"UUID: ccc6d4ce-52c4-4e65-91d2-293feca91fa9\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.873533978Z\",\"hostname\":\"buskin\",\"pid\":1093}\n{\"msg\":\"Blocks per extent:131072 Total Extents: 160\",\"v\":0,\"name\":\"crucible\",\"level\":30,\"time\":\"2024-03-22T05:09:18.873548598Z\",\"hostname\":\"buskin\",\"pid\":1093}\n","status":"ExitStatus(unix_wait_status(0))","stderr":"","path":"phd_tests::crucible::smoke::boot_test"}
21272024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.88171685Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000.stdout.log\"","path":"phd_tests::crucible::smoke::boot_test"}
21282024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.881790952Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9000\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000\"]","path":"phd_tests::crucible::smoke::boot_test"}
21292024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.881838963Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9000\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000\"]","path":"phd_tests::crucible::smoke::boot_test"}
21302024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.893881594Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001.stderr.log\"","path":"phd_tests::crucible::smoke::boot_test"}
21312024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.893983977Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9001\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001\"]","path":"phd_tests::crucible::smoke::boot_test"}
21322024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.894036639Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9001\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001\"]","path":"phd_tests::crucible::smoke::boot_test"}
21332024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.905791231Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002.stdout.log\"","path":"phd_tests::crucible::smoke::boot_test"}
21342024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Launching Crucible downstairs server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.905875884Z","target":"phd_framework::disk::crucible","line":238,"file":"phd-tests/framework/src/disk/crucible.rs","crucible_args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9002\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002\"]","path":"phd_tests::crucible::smoke::boot_test"}
21352024-03-22T05:09:19.111Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Running crucible-downstairs","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.905924875Z","target":"phd_framework::disk::crucible","line":346,"file":"phd-tests/framework/src/disk/crucible.rs","args":"[\"run\", \"--address\", \"127.0.0.1\", \"--port\", \"9002\", \"--data\", \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002\"]","path":"phd_tests::crucible::smoke::boot_test"}
21362024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.91746106Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test"}
21372024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.917583194Z","target":"phd_framework::test_vm","line":186,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","vm_name":"crucible_boot_test","spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"ccc6d4ce-52c4-4e65-91d2-293feca91fa9\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"2d4ea1e3-7635-443b-928d-f7ef9cbbe14d\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":1,\\\"opts\\\":{\\\"id\\\":\\\"2ac98187-daa6-4f34-b0b2-32fae04b4a22\\\",\\\"key\\\":\\\"+EKsGxzn4DPk8hJ4RAJ63G1eiJmeOrY/iV38ZuA8qI4=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::crucible::smoke::boot_test"}
21382024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.917694778Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::crucible::smoke::boot_test"}
21392024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.917782021Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9003","server_path":"\"/work/phd-test/propolis-server\"","config_toml_path":"\"/tmp/propolis-phd/crucible_boot_test.config.toml\"","path":"phd_tests::crucible::smoke::boot_test"}
21402024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.917833912Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/crucible_boot_test.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/crucible_boot_test.stdout.log\"","path":"phd_tests::crucible::smoke::boot_test"}
21412024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 1097","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.928650525Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::crucible::smoke::boot_test"}
21422024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.929018827Z","target":"phd_framework::test_vm","line":176,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test","elapsed_milliseconds":11}
21432024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.929097019Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21442024-03-22T05:09:19.140Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:18.929670847Z","target":"phd_framework::test_vm","line":325,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9003/instance/spec): error trying to connect: tcp connect error: Connection refused (os error 146)","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21452024-03-22T05:09:19.925Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.724898455Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
21462024-03-22T05:09:19.972Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.725535834Z","target":"phd_framework::test_vm","line":381,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { disks: [], nics: [], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: \"Pheidippides-managed VM\", id: a98b0b45-9616-4dc4-96f9-e78cff89a359, image_id: 00000000-0000-0000-0000-000000000000, memory: 512, metadata: InstanceMetadata { project_id: b8d5eb6a-d1ee-4796-9c93-0aeeda5883e0, silo_id: 788eb2eb-e674-4037-9279-fafc57c3a2f5 }, name: \"phd-vm-a98b0b45-9616-4dc4-96f9-e78cff89a359\", vcpus: 2 }, state: Creating }","self.spec.instance_spec":"InstanceSpecV0 { backends: BackendSpecV0 { network_backends: {}, storage_backends: {\"boot-disk\": Crucible(CrucibleStorageBackend { readonly: false, request_json: \"{\\\"type\\\":\\\"volume\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"ccc6d4ce-52c4-4e65-91d2-293feca91fa9\\\",\\\"read_only_parent\\\":{\\\"type\\\":\\\"file\\\",\\\"block_size\\\":512,\\\"id\\\":\\\"2d4ea1e3-7635-443b-928d-f7ef9cbbe14d\\\",\\\"path\\\":\\\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\\\"},\\\"sub_volumes\\\":[{\\\"type\\\":\\\"region\\\",\\\"block_size\\\":512,\\\"blocks_per_extent\\\":131072,\\\"extent_count\\\":160,\\\"gen\\\":1,\\\"opts\\\":{\\\"id\\\":\\\"2ac98187-daa6-4f34-b0b2-32fae04b4a22\\\",\\\"key\\\":\\\"+EKsGxzn4DPk8hJ4RAJ63G1eiJmeOrY/iV38ZuA8qI4=\\\",\\\"lossy\\\":false,\\\"read_only\\\":false,\\\"target\\\":[\\\"127.0.0.1:9000\\\",\\\"127.0.0.1:9001\\\",\\\"127.0.0.1:9002\\\"]}}]}\" })} }, devices: DeviceSpecV0 { board: Board { chipset: I440Fx(I440Fx { enable_pcie: false }), cpus: 2, memory_mb: 512 }, network_devices: {}, pci_pci_bridges: {}, qemu_pvpanic: None, serial_ports: {\"com1\": SerialPort { num: Com1 }}, storage_devices: {\"disk-device0\": NvmeDisk(NvmeDisk { backend_name: \"boot-disk\", pci_path: PciPath { bus: 0, device: 4, function: 0 } })} } }","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21472024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.725663718Z","target":"phd_framework::test_vm","line":272,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":796,"path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21482024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.725747201Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21492024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.725791772Z","target":"phd_framework::test_vm","line":442,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21502024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.72636272Z","target":"phd_framework::test_vm","line":437,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21512024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.726414531Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test"}
21522024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.726456313Z","target":"phd_framework::test_vm","line":645,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359","timeout_duration":"300s","vm":"crucible_boot_test","path":"phd_tests::crucible::smoke::boot_test"}
21532024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.726491374Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::crucible::smoke::boot_test"}
21542024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.726526015Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21552024-03-22T05:09:19.973Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:19.726558886Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21562024-03-22T05:09:24.759Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.558474302Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4831,"path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21572024-03-22T05:09:24.759Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.558558634Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::crucible::smoke::boot_test"}
21582024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.55873221Z","target":"phd_framework::test_vm","line":653,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::crucible::smoke::boot_test"}
21592024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.558783961Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21602024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.558820192Z","target":"phd_framework::test_vm","line":718,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21612024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.578300502Z","target":"phd_framework::test_vm","line":711,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":19,"path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21622024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.578357604Z","target":"phd_framework::test_vm","line":693,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test"}
21632024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.578388195Z","target":"phd_framework::test_vm","line":696,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test","elapsed_milliseconds":4851}
21642024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.578455787Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21652024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.57857429Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
21662024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.578658983Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":4853}
21672024-03-22T05:09:24.785Z{"v":0,"name":"phd-runner","msg":"test phd_tests::crucible::smoke::boot_test ... ok","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.578765436Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
21682024-03-22T05:09:24.786Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.57889944Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
21692024-03-22T05:09:24.786Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:24.579452028Z","target":"phd_framework::test_vm","line":974,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21702024-03-22T05:09:25.255Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.055487086Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9003","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21712024-03-22T05:09:25.393Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.193534138Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9000, data_dir: DataDirectory { path: \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000\" } }","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21722024-03-22T05:09:25.418Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.204286018Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000\"","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21732024-03-22T05:09:25.418Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.214306487Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9001, data_dir: DataDirectory { path: \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001\" } }","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21742024-03-22T05:09:25.444Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.227613867Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001\"","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21752024-03-22T05:09:25.444Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Stopping Crucible downstairs process","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.238325067Z","target":"phd_framework::disk::crucible","line":54,"file":"phd-tests/framework/src/disk/crucible.rs","self":"Downstairs { process_handle: Child { stdin: None, stdout: None, stderr: None, .. }, address: 127.0.0.1:9002, data_dir: DataDirectory { path: \"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002\" } }","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21762024-03-22T05:09:25.469Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Deleting Crucible downstairs data directory","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.25075128Z","target":"phd_framework::disk::crucible","line":35,"file":"phd-tests/framework/src/disk/crucible.rs","self.path":"\"/tmp/propolis-phd/ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002\"","path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21772024-03-22T05:09:25.469Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.261889543Z","target":"phd_framework::test_vm","line":951,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":683,"path":"phd_tests::crucible::smoke::boot_test","vm":"crucible_boot_test","vm_id":"a98b0b45-9616-4dc4-96f9-e78cff89a359"}
21782024-03-22T05:09:25.469Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.261961725Z","target":"phd_tests::crucible::smoke","line":10,"file":"phd-tests/tests/src/crucible/smoke.rs","path":"phd_tests::crucible::smoke::boot_test","elapsed_milliseconds":6565}
21792024-03-22T05:09:25.469Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.262185592Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":683}
21802024-03-22T05:09:25.469Z{"v":0,"name":"phd-runner","msg":"[EXECUTION_CLEANUP - START]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.262265514Z","target":"phd_runner::fixtures","line":35,"file":"phd-tests/runner/src/fixtures.rs"}
21812024-03-22T05:09:25.469Z{"v":0,"name":"phd-runner","msg":"[EXECUTION_CLEANUP - END]","level":30,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.262300095Z","target":"phd_runner::fixtures","line":35,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
21822024-03-22T05:09:25.469Ztest result: ok. 21 passed; 0 failed; 1 skipped; 0 not run; finished in 453.63s
21832024-03-22T05:09:25.469Z
21842024-03-22T05:09:25.469Z{"v":0,"name":"phd-runner","msg":"phd_runner","level":20,"hostname":"buskin","pid":858,"time":"2024-03-22T05:09:25.262385638Z","target":"phd_runner","line":40,"file":"phd-tests/runner/src/main.rs","exit_code":0}
21852024-03-22T05:09:25.507Z
21862024-03-22T05:09:25.557Zreal 7:34.416415302
21872024-03-22T05:09:25.557Zuser 4:20.900009493
21882024-03-22T05:09:25.557Zsys 1:38.965980701
21892024-03-22T05:09:25.557Ztrap 0.023474797
21902024-03-22T05:09:25.557Ztflt 0.063328181
21912024-03-22T05:09:25.557Zdflt 0.004730761
21922024-03-22T05:09:25.557Zkflt 0.001085693
21932024-03-22T05:09:25.557Zlock 19:51:12.393962453
21942024-03-22T05:09:25.558Zslp 30:14.985572736
21952024-03-22T05:09:25.558Zlat 4.907796614
21962024-03-22T05:09:25.558Zstop 1:19.657482176
21972024-03-22T05:09:25.558Z+ failcount=0
21982024-03-22T05:09:25.558Z+ set -e
21992024-03-22T05:09:25.558Z+ tar -czvf /tmp/phd-tmp-files.tar.gz -C /tmp/propolis-phd /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000.stderr.log /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000.stdout.log /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001.stderr.log /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001.stdout.log /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002.stderr.log /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002.stdout.log /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000.stderr.log /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000.stdout.log /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001.stderr.log /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001.stdout.log /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002.stderr.log /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002.stdout.log /tmp/propolis-phd/crucible_boot_test.serial.log /tmp/propolis-phd/crucible_boot_test.stderr.log /tmp/propolis-phd/crucible_boot_test.stdout.log /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000.stderr.log /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000.stdout.log /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001.stderr.log /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001.stdout.log /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002.stderr.log /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002.stdout.log /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9000.stderr.log /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9000.stdout.log /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9001.stderr.log /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9001.stdout.log /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9002.stderr.log /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9002.stdout.log /tmp/propolis-phd/crucible_load_test_source.serial.log /tmp/propolis-phd/crucible_load_test_source.stderr.log /tmp/propolis-phd/crucible_load_test_source.stdout.log /tmp/propolis-phd/crucible_load_test_target.stderr.log /tmp/propolis-phd/crucible_load_test_target.stdout.log /tmp/propolis-phd/crucible_migrate_smoke_source.serial.log /tmp/propolis-phd/crucible_migrate_smoke_source.stderr.log /tmp/propolis-phd/crucible_migrate_smoke_source.stdout.log /tmp/propolis-phd/crucible_migrate_smoke_target.stderr.log /tmp/propolis-phd/crucible_migrate_smoke_target.stdout.log /tmp/propolis-phd/crucible_shutdown_persistence_test.stderr.log /tmp/propolis-phd/crucible_shutdown_persistence_test.stdout.log /tmp/propolis-phd/instance_ensure_running_test.serial.log /tmp/propolis-phd/instance_ensure_running_test.stderr.log /tmp/propolis-phd/instance_ensure_running_test.stdout.log /tmp/propolis-phd/instance_reset_requires_running_test.serial.log /tmp/propolis-phd/instance_reset_requires_running_test.stderr.log /tmp/propolis-phd/instance_reset_requires_running_test.stdout.log /tmp/propolis-phd/instance_reset_returns_to_running_test.serial.log /tmp/propolis-phd/instance_reset_returns_to_running_test.stderr.log /tmp/propolis-phd/instance_reset_returns_to_running_test.stdout.log /tmp/propolis-phd/instance_spec_test.serial.log /tmp/propolis-phd/instance_spec_test.stderr.log /tmp/propolis-phd/instance_spec_test.stdout.log /tmp/propolis-phd/instance_stop_causes_destroy_test.serial.log /tmp/propolis-phd/instance_stop_causes_destroy_test.stderr.log /tmp/propolis-phd/instance_stop_causes_destroy_test.stdout.log /tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.serial.log /tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stderr.log /tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stdout.log /tmp/propolis-phd/lspci_lifecycle_test.serial.log /tmp/propolis-phd/lspci_lifecycle_test.stderr.log /tmp/propolis-phd/lspci_lifecycle_test.stdout.log /tmp/propolis-phd/migrate_running_process_source.serial.log /tmp/propolis-phd/migrate_running_process_source.stderr.log /tmp/propolis-phd/migrate_running_process_source.stdout.log /tmp/propolis-phd/migrate_running_process_target.stderr.log /tmp/propolis-phd/migrate_running_process_target.stdout.log /tmp/propolis-phd/migrate_running_process::export_failure_source.serial.log /tmp/propolis-phd/migrate_running_process::export_failure_source.stderr.log /tmp/propolis-phd/migrate_running_process::export_failure_source.stdout.log /tmp/propolis-phd/migrate_running_process::export_failure_target1.stderr.log /tmp/propolis-phd/migrate_running_process::export_failure_target1.stdout.log /tmp/propolis-phd/migrate_running_process::export_failure_target2.stderr.log /tmp/propolis-phd/migrate_running_process::export_failure_target2.stdout.log /tmp/propolis-phd/migrate_running_process::import_failure_source.serial.log /tmp/propolis-phd/migrate_running_process::import_failure_source.stderr.log /tmp/propolis-phd/migrate_running_process::import_failure_source.stdout.log /tmp/propolis-phd/migrate_running_process::import_failure_target1.stderr.log /tmp/propolis-phd/migrate_running_process::import_failure_target1.stdout.log /tmp/propolis-phd/migrate_running_process::import_failure_target2.stderr.log /tmp/propolis-phd/migrate_running_process::import_failure_target2.stdout.log /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stderr.log /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stdout.log /tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.stderr.log /tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.stdout.log /tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.stderr.log /tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.stdout.log /tmp/propolis-phd/migration_from_base_and_back.serial.log /tmp/propolis-phd/migration_from_base_and_back.stderr.log /tmp/propolis-phd/migration_from_base_and_back.stdout.log /tmp/propolis-phd/migration_from_base_lifecycle_0.stderr.log /tmp/propolis-phd/migration_from_base_lifecycle_0.stdout.log /tmp/propolis-phd/migration_from_base.serial.log /tmp/propolis-phd/migration_from_base.stderr.log /tmp/propolis-phd/migration_from_base.stdout.log /tmp/propolis-phd/migration_incompatible_source_0.serial.log /tmp/propolis-phd/migration_incompatible_source_0.stderr.log /tmp/propolis-phd/migration_incompatible_source_0.stdout.log /tmp/propolis-phd/migration_incompatible_source_1.serial.log /tmp/propolis-phd/migration_incompatible_source_1.stderr.log /tmp/propolis-phd/migration_incompatible_source_1.stdout.log /tmp/propolis-phd/migration_incompatible_target_1.stderr.log /tmp/propolis-phd/migration_incompatible_target_1.stdout.log /tmp/propolis-phd/migration_incompatible_target_2.stderr.log /tmp/propolis-phd/migration_incompatible_target_2.stdout.log /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stderr.log /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stdout.log /tmp/propolis-phd/migration_serial_history_base.serial.log /tmp/propolis-phd/migration_serial_history_base.stderr.log /tmp/propolis-phd/migration_serial_history_base.stdout.log /tmp/propolis-phd/migration_serial_history_lifecycle_0.stderr.log /tmp/propolis-phd/migration_serial_history_lifecycle_0.stdout.log /tmp/propolis-phd/migration_serial_history.serial.log /tmp/propolis-phd/migration_serial_history.stderr.log /tmp/propolis-phd/migration_serial_history.stdout.log /tmp/propolis-phd/migration_smoke_lifecycle_0.stderr.log /tmp/propolis-phd/migration_smoke_lifecycle_0.stdout.log /tmp/propolis-phd/migration_smoke.serial.log /tmp/propolis-phd/migration_smoke.stderr.log /tmp/propolis-phd/migration_smoke.stdout.log /tmp/propolis-phd/multiline_test.serial.log /tmp/propolis-phd/multiline_test.stderr.log /tmp/propolis-phd/multiline_test.stdout.log /tmp/propolis-phd/multiple_migrations_0.serial.log /tmp/propolis-phd/multiple_migrations_0.stderr.log /tmp/propolis-phd/multiple_migrations_0.stdout.log /tmp/propolis-phd/multiple_migrations_1.stderr.log /tmp/propolis-phd/multiple_migrations_1.stdout.log /tmp/propolis-phd/multiple_migrations_2.stderr.log /tmp/propolis-phd/multiple_migrations_2.stdout.log /tmp/propolis-phd/nproc_test.serial.log /tmp/propolis-phd/nproc_test.stderr.log /tmp/propolis-phd/nproc_test.stdout.log -C /tmp/propolis-phd /tmp/propolis-phd/crucible_boot_test.config.toml /tmp/propolis-phd/crucible_load_test_source.config.toml /tmp/propolis-phd/crucible_load_test_target.config.toml /tmp/propolis-phd/crucible_migrate_smoke_source.config.toml /tmp/propolis-phd/crucible_migrate_smoke_target.config.toml /tmp/propolis-phd/crucible_shutdown_persistence_test.config.toml /tmp/propolis-phd/instance_ensure_running_test.config.toml /tmp/propolis-phd/instance_reset_requires_running_test.config.toml /tmp/propolis-phd/instance_reset_returns_to_running_test.config.toml /tmp/propolis-phd/instance_spec_test.config.toml /tmp/propolis-phd/instance_stop_causes_destroy_test.config.toml /tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.config.toml /tmp/propolis-phd/lspci_lifecycle_test.config.toml /tmp/propolis-phd/migrate_running_process_source.config.toml /tmp/propolis-phd/migrate_running_process_target.config.toml /tmp/propolis-phd/migrate_running_process::export_failure_source.config.toml /tmp/propolis-phd/migrate_running_process::export_failure_target1.config.toml /tmp/propolis-phd/migrate_running_process::export_failure_target2.config.toml /tmp/propolis-phd/migrate_running_process::import_failure_source.config.toml /tmp/propolis-phd/migrate_running_process::import_failure_target1.config.toml /tmp/propolis-phd/migrate_running_process::import_failure_target2.config.toml /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.config.toml /tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.config.toml /tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.config.toml /tmp/propolis-phd/migration_from_base_and_back.config.toml /tmp/propolis-phd/migration_from_base_lifecycle_0.config.toml /tmp/propolis-phd/migration_from_base.config.toml /tmp/propolis-phd/migration_incompatible_source_0.config.toml /tmp/propolis-phd/migration_incompatible_source_1.config.toml /tmp/propolis-phd/migration_incompatible_target_1.config.toml /tmp/propolis-phd/migration_incompatible_target_2.config.toml /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.config.toml /tmp/propolis-phd/migration_serial_history_base.config.toml /tmp/propolis-phd/migration_serial_history_lifecycle_0.config.toml /tmp/propolis-phd/migration_serial_history.config.toml /tmp/propolis-phd/migration_smoke_lifecycle_0.config.toml /tmp/propolis-phd/migration_smoke.config.toml /tmp/propolis-phd/multiline_test.config.toml /tmp/propolis-phd/multiple_migrations_0.config.toml /tmp/propolis-phd/multiple_migrations_1.config.toml /tmp/propolis-phd/multiple_migrations_2.config.toml /tmp/propolis-phd/nproc_test.config.toml
22002024-03-22T05:09:25.558ZCompressing '/tmp/phd-tmp-files.tar.gz' with '/usr/bin/gzip'...
22012024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000.stderr.log 0K
22022024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9000.stdout.log 7K
22032024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001.stderr.log 0K
22042024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9001.stdout.log 7K
22052024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002.stderr.log 0K
22062024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_20ab108f-1fe6-46c5-8ddd-b83a2c7442df_9002.stdout.log 7K
22072024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000.stderr.log 0K
22082024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9000.stdout.log 7K
22092024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001.stderr.log 0K
22102024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9001.stdout.log 7K
22112024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002.stderr.log 0K
22122024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_5df54bb5-2bb2-44f6-9042-04c0f74f1a94_9002.stdout.log 7K
22132024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_boot_test.serial.log 7K
22142024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_boot_test.stderr.log 0K
22152024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_boot_test.stdout.log 45K
22162024-03-22T05:09:25.558Za /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000.stderr.log 0K
22172024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9000.stdout.log 5K
22182024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001.stderr.log 0K
22192024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9001.stdout.log 5K
22202024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002.stderr.log 0K
22212024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ccc6d4ce-52c4-4e65-91d2-293feca91fa9_9002.stdout.log 5K
22222024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9000.stderr.log 0K
22232024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9000.stdout.log 1K
22242024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9001.stderr.log 0K
22252024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9001.stdout.log 1K
22262024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9002.stderr.log 0K
22272024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_ee7b096f-0ea5-42be-a529-065fbb00c587_9002.stdout.log 1K
22282024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_load_test_source.serial.log 7K
22292024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_load_test_source.stderr.log 0K
22302024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_load_test_source.stdout.log 132K
22312024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_load_test_target.stderr.log 0K
22322024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_load_test_target.stdout.log 127K
22332024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_migrate_smoke_source.serial.log 7K
22342024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_migrate_smoke_source.stderr.log 0K
22352024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_migrate_smoke_source.stdout.log 132K
22362024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_migrate_smoke_target.stderr.log 0K
22372024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_migrate_smoke_target.stdout.log 127K
22382024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_shutdown_persistence_test.stderr.log 0K
22392024-03-22T05:09:25.559Za /tmp/propolis-phd/crucible_shutdown_persistence_test.stdout.log 0K
22402024-03-22T05:09:25.559Za /tmp/propolis-phd/instance_ensure_running_test.serial.log 0K
22412024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_ensure_running_test.stderr.log 0K
22422024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_ensure_running_test.stdout.log 25K
22432024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_reset_requires_running_test.serial.log 0K
22442024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_reset_requires_running_test.stderr.log 0K
22452024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_reset_requires_running_test.stdout.log 26K
22462024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_reset_returns_to_running_test.serial.log 0K
22472024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_reset_returns_to_running_test.stderr.log 0K
22482024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_reset_returns_to_running_test.stdout.log 61K
22492024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_spec_test.serial.log 0K
22502024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_spec_test.stderr.log 0K
22512024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_spec_test.stdout.log 30K
22522024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_stop_causes_destroy_test.serial.log 0K
22532024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_stop_causes_destroy_test.stderr.log 0K
22542024-03-22T05:09:25.560Za /tmp/propolis-phd/instance_stop_causes_destroy_test.stdout.log 26K
22552024-03-22T05:09:25.560Za /tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.serial.log 7K
22562024-03-22T05:09:25.560Za /tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stderr.log 0K
22572024-03-22T05:09:25.560Za /tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.stdout.log 26K
22582024-03-22T05:09:25.560Za /tmp/propolis-phd/lspci_lifecycle_test.serial.log 7K
22592024-03-22T05:09:25.560Za /tmp/propolis-phd/lspci_lifecycle_test.stderr.log 0K
22602024-03-22T05:09:25.560Za /tmp/propolis-phd/lspci_lifecycle_test.stdout.log 25K
22612024-03-22T05:09:25.560Za /tmp/propolis-phd/migrate_running_process_source.serial.log 8K
22622024-03-22T05:09:25.560Za /tmp/propolis-phd/migrate_running_process_source.stderr.log 0K
22632024-03-22T05:09:25.560Za /tmp/propolis-phd/migrate_running_process_source.stdout.log 104K
22642024-03-22T05:09:25.560Za /tmp/propolis-phd/migrate_running_process_target.stderr.log 0K
22652024-03-22T05:09:25.561Za /tmp/propolis-phd/migrate_running_process_target.stdout.log 108K
22662024-03-22T05:09:25.561Za /tmp/propolis-phd/migrate_running_process::export_failure_source.serial.log 8K
22672024-03-22T05:09:25.561Za /tmp/propolis-phd/migrate_running_process::export_failure_source.stderr.log 0K
22682024-03-22T05:09:25.561Za /tmp/propolis-phd/migrate_running_process::export_failure_source.stdout.log 125K
22692024-03-22T05:09:25.561Za /tmp/propolis-phd/migrate_running_process::export_failure_target1.stderr.log 0K
22702024-03-22T05:09:25.593Za /tmp/propolis-phd/migrate_running_process::export_failure_target1.stdout.log 33K
22712024-03-22T05:09:25.593Za /tmp/propolis-phd/migrate_running_process::export_failure_target2.stderr.log 0K
22722024-03-22T05:09:25.593Za /tmp/propolis-phd/migrate_running_process::export_failure_target2.stdout.log 110K
22732024-03-22T05:09:25.593Za /tmp/propolis-phd/migrate_running_process::import_failure_source.serial.log 8K
22742024-03-22T05:09:25.593Za /tmp/propolis-phd/migrate_running_process::import_failure_source.stderr.log 0K
22752024-03-22T05:09:25.593Za /tmp/propolis-phd/migrate_running_process::import_failure_source.stdout.log 196K
22762024-03-22T05:09:25.593Za /tmp/propolis-phd/migrate_running_process::import_failure_target1.stderr.log 0K
22772024-03-22T05:09:25.593Za /tmp/propolis-phd/migrate_running_process::import_failure_target1.stdout.log 106K
22782024-03-22T05:09:25.594Za /tmp/propolis-phd/migrate_running_process::import_failure_target2.stderr.log 0K
22792024-03-22T05:09:25.594Za /tmp/propolis-phd/migrate_running_process::import_failure_target2.stdout.log 110K
22802024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stderr.log 0K
22812024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stdout.log 186K
22822024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.stderr.log 0K
22832024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.stdout.log 186K
22842024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.stderr.log 0K
22852024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.stdout.log 109K
22862024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back.serial.log 7K
22872024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back.stderr.log 0K
22882024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_and_back.stdout.log 104K
22892024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_lifecycle_0.stderr.log 0K
22902024-03-22T05:09:25.594Za /tmp/propolis-phd/migration_from_base_lifecycle_0.stdout.log 108K
22912024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_from_base.serial.log 7K
22922024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_from_base.stderr.log 0K
22932024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_from_base.stdout.log 104K
22942024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_source_0.serial.log 0K
22952024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_source_0.stderr.log 0K
22962024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_source_0.stdout.log 35K
22972024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_source_1.serial.log 0K
22982024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_source_1.stderr.log 0K
22992024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_source_1.stdout.log 36K
23002024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_target_1.stderr.log 0K
23012024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_target_1.stdout.log 37K
23022024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_target_2.stderr.log 0K
23032024-03-22T05:09:25.595Za /tmp/propolis-phd/migration_incompatible_target_2.stdout.log 27K
23042024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stderr.log 0K
23052024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stdout.log 109K
23062024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history_base.serial.log 7K
23072024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history_base.stderr.log 0K
23082024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history_base.stdout.log 105K
23092024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history_lifecycle_0.stderr.log 0K
23102024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history_lifecycle_0.stdout.log 108K
23112024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history.serial.log 7K
23122024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history.stderr.log 0K
23132024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_serial_history.stdout.log 104K
23142024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_smoke_lifecycle_0.stderr.log 0K
23152024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_smoke_lifecycle_0.stdout.log 109K
23162024-03-22T05:09:25.596Za /tmp/propolis-phd/migration_smoke.serial.log 7K
23172024-03-22T05:09:25.597Za /tmp/propolis-phd/migration_smoke.stderr.log 0K
23182024-03-22T05:09:25.597Za /tmp/propolis-phd/migration_smoke.stdout.log 104K
23192024-03-22T05:09:25.597Za /tmp/propolis-phd/multiline_test.serial.log 7K
23202024-03-22T05:09:25.597Za /tmp/propolis-phd/multiline_test.stderr.log 0K
23212024-03-22T05:09:25.597Za /tmp/propolis-phd/multiline_test.stdout.log 26K
23222024-03-22T05:09:25.597Za /tmp/propolis-phd/multiple_migrations_0.serial.log 7K
23232024-03-22T05:09:25.597Za /tmp/propolis-phd/multiple_migrations_0.stderr.log 0K
23242024-03-22T05:09:25.597Za /tmp/propolis-phd/multiple_migrations_0.stdout.log 104K
23252024-03-22T05:09:25.597Za /tmp/propolis-phd/multiple_migrations_1.stderr.log 0K
23262024-03-22T05:09:25.597Za /tmp/propolis-phd/multiple_migrations_1.stdout.log 186K
23272024-03-22T05:09:25.597Za /tmp/propolis-phd/multiple_migrations_2.stderr.log 0K
23282024-03-22T05:09:25.597Za /tmp/propolis-phd/multiple_migrations_2.stdout.log 108K
23292024-03-22T05:09:25.597Za /tmp/propolis-phd/nproc_test.serial.log 7K
23302024-03-22T05:09:25.598Za /tmp/propolis-phd/nproc_test.stderr.log 0K
23312024-03-22T05:09:25.598Za /tmp/propolis-phd/nproc_test.stdout.log 35K
23322024-03-22T05:09:25.598Za /tmp/propolis-phd/crucible_boot_test.config.toml 1K
23332024-03-22T05:09:25.598Za /tmp/propolis-phd/crucible_load_test_source.config.toml 1K
23342024-03-22T05:09:25.598Za /tmp/propolis-phd/crucible_load_test_target.config.toml 1K
23352024-03-22T05:09:25.598Za /tmp/propolis-phd/crucible_migrate_smoke_source.config.toml 1K
23362024-03-22T05:09:25.598Za /tmp/propolis-phd/crucible_migrate_smoke_target.config.toml 1K
23372024-03-22T05:09:25.598Za /tmp/propolis-phd/crucible_shutdown_persistence_test.config.toml 1K
23382024-03-22T05:09:25.598Za /tmp/propolis-phd/instance_ensure_running_test.config.toml 1K
23392024-03-22T05:09:25.598Za /tmp/propolis-phd/instance_reset_requires_running_test.config.toml 1K
23402024-03-22T05:09:25.598Za /tmp/propolis-phd/instance_reset_returns_to_running_test.config.toml 1K
23412024-03-22T05:09:25.598Za /tmp/propolis-phd/instance_spec_test.config.toml 1K
23422024-03-22T05:09:25.598Za /tmp/propolis-phd/instance_stop_causes_destroy_test.config.toml 1K
23432024-03-22T05:09:25.599Za /tmp/propolis-phd/lspci_lifecycle_test_lifecycle_0.config.toml 1K
23442024-03-22T05:09:25.599Za /tmp/propolis-phd/lspci_lifecycle_test.config.toml 1K
23452024-03-22T05:09:25.599Za /tmp/propolis-phd/migrate_running_process_source.config.toml 1K
23462024-03-22T05:09:25.599Za /tmp/propolis-phd/migrate_running_process_target.config.toml 1K
23472024-03-22T05:09:25.599Za /tmp/propolis-phd/migrate_running_process::export_failure_source.config.toml 1K
23482024-03-22T05:09:25.599Za /tmp/propolis-phd/migrate_running_process::export_failure_target1.config.toml 1K
23492024-03-22T05:09:25.599Za /tmp/propolis-phd/migrate_running_process::export_failure_target2.config.toml 1K
23502024-03-22T05:09:25.599Za /tmp/propolis-phd/migrate_running_process::import_failure_source.config.toml 1K
23512024-03-22T05:09:25.599Za /tmp/propolis-phd/migrate_running_process::import_failure_target1.config.toml 1K
23522024-03-22T05:09:25.599Za /tmp/propolis-phd/migrate_running_process::import_failure_target2.config.toml 1K
23532024-03-22T05:09:25.599Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.config.toml 1K
23542024-03-22T05:09:25.599Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_1.config.toml 1K
23552024-03-22T05:09:25.599Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_2.config.toml 1K
23562024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_from_base_and_back.config.toml 1K
23572024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_from_base_lifecycle_0.config.toml 1K
23582024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_from_base.config.toml 1K
23592024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_incompatible_source_0.config.toml 1K
23602024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_incompatible_source_1.config.toml 1K
23612024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_incompatible_target_1.config.toml 1K
23622024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_incompatible_target_2.config.toml 1K
23632024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.config.toml 1K
23642024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_serial_history_base.config.toml 1K
23652024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_serial_history_lifecycle_0.config.toml 1K
23662024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_serial_history.config.toml 1K
23672024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_smoke_lifecycle_0.config.toml 1K
23682024-03-22T05:09:25.600Za /tmp/propolis-phd/migration_smoke.config.toml 1K
23692024-03-22T05:09:25.601Za /tmp/propolis-phd/multiline_test.config.toml 1K
23702024-03-22T05:09:25.629Za /tmp/propolis-phd/multiple_migrations_0.config.toml 1K
23712024-03-22T05:09:25.629Za /tmp/propolis-phd/multiple_migrations_1.config.toml 1K
23722024-03-22T05:09:25.629Za /tmp/propolis-phd/multiple_migrations_2.config.toml 1K
23732024-03-22T05:09:25.629Za /tmp/propolis-phd/nproc_test.config.toml 1K
23742024-03-22T05:09:25.630Z+ exitcode=0
23752024-03-22T05:09:25.630Z+ '[' 0 -eq 0 ']'
23762024-03-22T05:09:25.630Z+ echo
23772024-03-22T05:09:25.630Z
23782024-03-22T05:09:25.630Z+ echo 'ALL TESTS PASSED'
23792024-03-22T05:09:25.630ZALL TESTS PASSED
23802024-03-22T05:09:25.630Z
23812024-03-22T05:09:25.630Z+ echo
23822024-03-22T05:09:25.630Z+ find /dev/vmm -mindepth 1 -maxdepth 1
23832024-03-22T05:09:25.630Z+ read
23842024-03-22T05:09:25.630Z+ exit 0
23852024-03-22T05:09:25.630Zprocess exited: duration 463574 ms, exit code 0
 
23862024-03-22T05:09:25.709Zfound 2 output files
23872024-03-22T05:09:25.709Zuploading: /tmp/phd-runner.log (934452 bytes)
23882024-03-22T05:09:26.955Zuploaded: /tmp/phd-runner.log
23892024-03-22T05:09:26.956Zuploading: /tmp/phd-tmp-files.tar.gz (318197 bytes)
23902024-03-22T05:09:28.244Zuploaded: /tmp/phd-tmp-files.tar.gz