01JJ5SP5F4WZ5FEEYMAKRV4GHF: phd-run-migrate-from-base

BasicConfig {
    output_rules: [
        "/tmp/phd-runner.log",
        "/tmp/phd-tmp-files.tar.gz",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01JJ5SPD7EGK93S6A33NP3DHPS

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12025-01-22T01:30:50.600Zjob dependencies complete; ready to run (waiting for 7 m 38 s)
22025-01-22T01:35:35.230Zjob assigned to worker 01JJ5T4G8213893Y4JRWF4G7EJ [factory lab, buskin/13081] (queued for 4 m 44 s)
32025-01-22T01:35:35.403Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42025-01-22T01:35:35.449Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52025-01-22T01:35:35.506Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62025-01-22T01:35:35.539Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72025-01-22T01:35:35.573Zhttp://172.20.0.5:9969/postboot/buskin... ok
82025-01-22T01:35:35.607ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92025-01-22T01:35:35.641Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102025-01-22T01:35:35.674ZOxide Helios Version helios-2.0.23032 64-bit
112025-01-22T01:35:35.708ZConfiguring devices.
122025-01-22T01:35:35.743Z##################################################
132025-01-22T01:35:35.776Z#### ############# ##
142025-01-22T01:35:35.809Z### ### ############ ##
152025-01-22T01:35:35.873Z## ### # ## ### ## Oxide Computer Company ##
162025-01-22T01:35:35.920Z## ## ## ### # ### ##
172025-01-22T01:35:35.954Z## # ### #### #### This Station Under ##
182025-01-22T01:35:35.987Z### ### #### # ### Computer Control ##
192025-01-22T01:35:36.021Z#### #### ### ## ##
202025-01-22T01:35:36.192Z##################################################
212025-01-22T01:35:36.310ZHostname: buskin
222025-01-22T01:35:36.388ZLoading smf(7) service descriptions:
232025-01-22T01:35:36.767Zdownloading input: /input/phd-build/out/phd-run-with-args.sh
242025-01-22T01:35:36.859Zdownloaded input: /input/phd-build/out/phd-run-with-args.sh
252025-01-22T01:35:36.882Zdownloading input: /input/phd-build/out/phd-runner.sha256.txt
262025-01-22T01:35:36.957Zdownloaded input: /input/phd-build/out/phd-runner.sha256.txt
272025-01-22T01:35:36.957Zdownloading input: /input/phd-build/out/phd-runner.tar.gz
282025-01-22T01:35:48.666Zdownloaded input: /input/phd-build/out/phd-runner.tar.gz
292025-01-22T01:35:48.666Zdownloading input: /input/phd-build/out/propolis-server-debug.sha256.txt
302025-01-22T01:35:48.724Zdownloaded input: /input/phd-build/out/propolis-server-debug.sha256.txt
312025-01-22T01:35:48.748Zdownloading input: /input/phd-build/out/propolis-server-debug.tar.gz
322025-01-22T01:36:12.245Zdownloaded input: /input/phd-build/out/propolis-server-debug.tar.gz
 
332025-01-22T01:36:12.269Zstarting task 0: "setup"
342025-01-22T01:36:12.269Z++ uname -s
352025-01-22T01:36:12.269Z+ kern=SunOS
362025-01-22T01:36:12.269Z+ case "$kern" in
372025-01-22T01:36:12.269Z+ groupadd -g 12345 build
382025-01-22T01:36:12.269Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
392025-01-22T01:36:14.263Z+ zfs create -o mountpoint=/work rpool/work
402025-01-22T01:36:14.310Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
412025-01-22T01:36:14.334Z+ home_fs=zfs
422025-01-22T01:36:14.334Z+ [[ zfs == autofs ]]
432025-01-22T01:36:14.334Z+ mkdir -p /home/build
442025-01-22T01:36:14.335Z+ chown build:build /home/build /work
452025-01-22T01:36:16.318Z+ chmod 0700 /home/build /work
462025-01-22T01:36:16.342Zprocess exited: duration 4076 ms, exit code 0
 
472025-01-22T01:36:16.390Zstarting task 1: "authentication"
482025-01-22T01:36:16.433Zprocess exited: duration 42 ms, exit code 0
 
492025-01-22T01:36:16.480Zstarting task 2: "build"
502025-01-22T01:36:16.503Z+ indir=/input
512025-01-22T01:36:16.503Z+ indir_suffix='phd-build/out/*.tar.gz'
522025-01-22T01:36:16.503Z+ phddir=/work/phd-test
532025-01-22T01:36:16.503Z+ pfexec zpool create -f phd-artifacts c1t1d0 c2t1d0
542025-01-22T01:36:16.631Z+ artifactdir=/phd-artifacts
552025-01-22T01:36:16.632Z+ banner Inputs
562025-01-22T01:36:16.655Z ###
572025-01-22T01:36:16.655Z # # # ##### # # ##### ####
582025-01-22T01:36:16.655Z # ## # # # # # # #
592025-01-22T01:36:16.655Z # # # # # # # # # ####
602025-01-22T01:36:16.655Z # # # # ##### # # # #
612025-01-22T01:36:16.655Z # # ## # # # # # #
622025-01-22T01:36:16.655Z ### # # # #### # ####
632025-01-22T01:36:16.655Z
642025-01-22T01:36:16.655Z+ find /input -ls
652025-01-22T01:36:16.655Z 34 1 drwxr-xr-x 3 root root 3 Jan 22 01:35 /input
662025-01-22T01:36:16.655Z 2 1 drwxr-xr-x 3 root root 3 Jan 22 01:35 /input/phd-build
672025-01-22T01:36:16.655Z 3 2 drwxr-xr-x 2 root root 7 Jan 22 01:35 /input/phd-build/out
682025-01-22T01:36:16.655Z 4 2 -rw-r--r-- 1 root root 1746 Jan 22 01:35 /input/phd-build/out/phd-run-with-args.sh
692025-01-22T01:36:16.655Z 8 135685 -rw-r--r-- 1 root root 138847874 Jan 22 01:36 /input/phd-build/out/propolis-server-debug.tar.gz
702025-01-22T01:36:16.655Z 5 1 -rw-r--r-- 1 root root 65 Jan 22 01:35 /input/phd-build/out/phd-runner.sha256.txt
712025-01-22T01:36:16.655Z 7 1 -rw-r--r-- 1 root root 65 Jan 22 01:35 /input/phd-build/out/propolis-server-debug.sha256.txt
722025-01-22T01:36:16.656Z 6 67896 -rw-r--r-- 1 root root 69479034 Jan 22 01:35 /input/phd-build/out/phd-runner.tar.gz
732025-01-22T01:36:16.656Z+ rm -rf /work/phd-test
742025-01-22T01:36:16.656Z+ mkdir /work/phd-test
752025-01-22T01:36:16.656Z+ for p in $indir/$indir_suffix
762025-01-22T01:36:16.656Z+ tar xzvf /input/phd-build/out/phd-runner.tar.gz -C /work/phd-test
772025-01-22T01:36:18.148ZDecompressing '/input/phd-build/out/phd-runner.tar.gz' with '/usr/bin/gzcat'...
782025-01-22T01:36:18.149Zx phd-runner, 246871584 bytes, 482172 tape blocks
792025-01-22T01:36:18.149Zx artifacts.toml, 548 bytes, 2 tape blocks
802025-01-22T01:36:18.172Z++ tar tf /input/phd-build/out/phd-runner.tar.gz
812025-01-22T01:36:19.616Z+ for f in $(tar tf "$p")
822025-01-22T01:36:19.616Z+ chmod +x /work/phd-test/phd-runner
832025-01-22T01:36:19.639Z+ for f in $(tar tf "$p")
842025-01-22T01:36:19.639Z+ chmod +x /work/phd-test/artifacts.toml
852025-01-22T01:36:19.639Z+ for p in $indir/$indir_suffix
862025-01-22T01:36:19.639Z+ tar xzvf /input/phd-build/out/propolis-server-debug.tar.gz -C /work/phd-test
872025-01-22T01:36:22.842ZDecompressing '/input/phd-build/out/propolis-server-debug.tar.gz' with '/usr/bin/gzcat'...
882025-01-22T01:36:22.842Zx propolis-server, 526224016 bytes, 1027782 tape blocks
892025-01-22T01:36:22.865Z++ tar tf /input/phd-build/out/propolis-server-debug.tar.gz
902025-01-22T01:36:25.736Z+ for f in $(tar tf "$p")
912025-01-22T01:36:25.737Z+ chmod +x /work/phd-test/propolis-server
922025-01-22T01:36:25.761Z+ ls /work/phd-test
932025-01-22T01:36:25.761Zartifacts.toml
942025-01-22T01:36:25.761Zphd-runner
952025-01-22T01:36:25.761Zpropolis-server
962025-01-22T01:36:25.761Z+ banner Setup
972025-01-22T01:36:25.761Z #####
982025-01-22T01:36:25.761Z# # ###### ##### # # #####
992025-01-22T01:36:25.761Z# # # # # # #
1002025-01-22T01:36:25.761Z ##### ##### # # # # #
1012025-01-22T01:36:25.761Z # # # # # #####
1022025-01-22T01:36:25.761Z# # # # # # #
1032025-01-22T01:36:25.761Z ##### ###### # #### #
1042025-01-22T01:36:25.761Z
1052025-01-22T01:36:25.761Z+ tmpdir=/tmp/propolis-phd
1062025-01-22T01:36:25.761Z+ '[' '!' -d /tmp/propolis-phd ']'
1072025-01-22T01:36:25.761Z+ mkdir /tmp/propolis-phd
1082025-01-22T01:36:25.761Z+ banner Tests
1092025-01-22T01:36:25.761Z#######
1102025-01-22T01:36:25.761Z # ###### #### ##### ####
1112025-01-22T01:36:25.761Z # # # # #
1122025-01-22T01:36:25.761Z # ##### #### # ####
1132025-01-22T01:36:25.761Z # # # # #
1142025-01-22T01:36:25.761Z # # # # # # #
1152025-01-22T01:36:25.761Z # ###### #### # ####
1162025-01-22T01:36:25.761Z
1172025-01-22T01:36:25.761Z+ runner=/work/phd-test/phd-runner
1182025-01-22T01:36:25.761Z+ artifacts=/work/phd-test/artifacts.toml
1192025-01-22T01:36:25.761Z+ propolis=/work/phd-test/propolis-server
1202025-01-22T01:36:25.761Z+ ls /work/phd-test/phd-runner
1212025-01-22T01:36:25.761Z/work/phd-test/phd-runner
1222025-01-22T01:36:25.761Z+ ls /work/phd-test/artifacts.toml
1232025-01-22T01:36:25.761Z/work/phd-test/artifacts.toml
1242025-01-22T01:36:25.761Z+ ls /work/phd-test/propolis-server
1252025-01-22T01:36:25.761Z/work/phd-test/propolis-server
1262025-01-22T01:36:25.761Z+ args=($runner '--emit-bunyan' 'run' '--propolis-server-cmd' $propolis '--crucible-downstairs-commit' 'auto' '--artifact-toml-path' $artifacts '--tmp-directory' $tmpdir '--artifact-directory' $artifactdir $@)
1272025-01-22T01:36:25.762Z+ set +e
1282025-01-22T01:36:25.762Z+ RUST_BACKTRACE=1
1292025-01-22T01:36:25.762Z+ RUST_LOG=info,phd=debug
1302025-01-22T01:36:25.762Z+ ptime -m pfexec /work/phd-test/phd-runner --emit-bunyan run --propolis-server-cmd /work/phd-test/propolis-server --crucible-downstairs-commit auto --artifact-toml-path /work/phd-test/artifacts.toml --tmp-directory /tmp/propolis-phd --artifact-directory /phd-artifacts --include-filter phd_tests::migrate::from_base --base-propolis-branch master
1312025-01-22T01:36:25.762Z+ tee /tmp/phd-runner.log
1322025-01-22T01:36:25.787Z{"v":0,"name":"phd-runner","msg":"phd_runner","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:25.82199275Z","target":"phd_runner","line":35,"file":"phd-tests/runner/src/main.rs","runner_args":"ProcessArgs { command: Run(RunOptions { propolis_server_cmd: \"/work/phd-test/propolis-server\", base_propolis_branch: Some(\"master\"), base_propolis_commit: None, base_propolis_cmd: None, crucible_downstairs_cmd: None, crucible_downstairs_commit: Some(Auto), tmp_directory: \"/tmp/propolis-phd\", artifact_directory: Some(\"/phd-artifacts\"), server_logging_mode: TmpFile, default_guest_cpus: 2, default_guest_memory_mib: 512, artifact_toml_path: \"/work/phd-test/artifacts.toml\", default_guest_artifact: \"alpine\", default_bootrom_artifact: \"ovmf\", include_filter: [\"phd_tests::migrate::from_base\"], exclude_filter: [], max_buildomat_wait_secs: 1200 }), disable_ansi: false, emit_bunyan: true }"}
1332025-01-22T01:36:25.811Z{"v":0,"name":"phd-runner","msg":"Created new artifact store from manifest","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:25.824142832Z","target":"phd_framework::artifacts::store","line":221,"file":"phd-tests/framework/src/artifacts/store.rs","store":"Store { local_dir: \"/phd-artifacts\", artifacts: {\"alpine\": Mutex { data: StoredArtifact { description: Artifact { filename: \"alpine.iso\", kind: GuestOs(Alpine), source: RemoteServer { sha256: \"ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1\" }, untar: None }, cached_path: None } }, \"ovmf\": Mutex { data: StoredArtifact { description: Artifact { filename: \"OVMF_CODE.fd\", kind: Bootrom, source: Buildomat(BuildomatArtifact { repo: Repo(\"oxidecomputer/edk2\"), series: Series(\"image_debug\"), commit: Commit(\"6d92acf0a22718dd4175d7c64dbcf7aaec3740bd\"), sha256: \"29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f\" }), untar: None }, cached_path: None } }}, downloader: DownloadConfig { timeout: 600s, buildomat_backoff: ExponentialBackoff { current_interval: 1s, initial_interval: 1s, randomization_factor: 0.5, multiplier: 1.5, max_interval: 60s, start_time: Instant { tv_sec: 495, tv_nsec: 817927855 }, max_elapsed_time: Some(1200s), clock: SystemClock }, remote_server_uris: [\"https://oxide-omicron-build.s3.amazonaws.com\"] } }"}
1342025-01-22T01:36:25.811Z{"v":0,"name":"phd-runner","msg":"Adding Propolis server from local command","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:25.824201162Z","target":"phd_framework::artifacts::store","line":229,"file":"phd-tests/framework/src/artifacts/store.rs","propolis_server_cmd":"/work/phd-test/propolis-server"}
1352025-01-22T01:36:25.811Z{"v":0,"name":"phd-runner","msg":"Adding crucible-downstairs from Buildomat Git revision","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:25.824326934Z","target":"phd_framework::artifacts::store","line":313,"file":"phd-tests/framework/src/artifacts/store.rs","commit":"c9d31d2f84ff5b59dfb1cf5358d8af657ab9b5e9"}
1362025-01-22T01:36:25.811Z{"v":0,"name":"phd-runner","msg":"Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:25.824401364Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","timeout":"600s","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/crucible/nightly-image/c9d31d2f84ff5b59dfb1cf5358d8af657ab9b5e9/crucible-nightly.sha256.txt"}
1372025-01-22T01:36:25.980Z{"v":0,"name":"phd-runner","msg":"Adding 'current' Propolis server from Buildomat Git branch 'master'","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.015418045Z","target":"phd_framework::artifacts::store","line":250,"file":"phd-tests/framework/src/artifacts/store.rs"}
1382025-01-22T01:36:26.400Z{"v":0,"name":"phd-runner","msg":"Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.435404584Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","timeout":"600s","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/propolis/phd_build/6f40d5ea67ec684eca17385ea9496b5e851acde1/propolis-server.sha256.txt"}
1392025-01-22T01:36:26.503Z{"v":0,"name":"phd-runner","msg":"[EXECUTION_SETUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.537828345Z","target":"phd_runner::fixtures","line":25,"file":"phd-tests/runner/src/fixtures.rs"}
1402025-01-22T01:36:26.527Z{"v":0,"name":"phd-runner","msg":"[EXECUTION_SETUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.537989307Z","target":"phd_runner::fixtures","line":25,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
1412025-01-22T01:36:26.527Z{"v":0,"name":"phd-runner","msg":"Running 3 test(s)","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.538188738Z","target":"phd_runner::execute","line":82,"file":"phd-tests/runner/src/execute.rs"}
1422025-01-22T01:36:26.527Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::from_base::migration_from_base_and_back","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.53827505Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
1432025-01-22T01:36:26.527Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.53833033Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
1442025-01-22T01:36:26.527Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.53838698Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
1452025-01-22T01:36:26.527Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.538824915Z","target":"phd_tests::migrate::from_base","line":52,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1462025-01-22T01:36:26.527Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] checking for existing copy of artifact","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.539205079Z","target":"phd_framework::artifacts::store","line":89,"file":"phd-tests/framework/src/artifacts/store.rs","maybe_path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1472025-01-22T01:36:26.527Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:26.53936577Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","timeout":"600s","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/edk2/image_debug/6d92acf0a22718dd4175d7c64dbcf7aaec3740bd/OVMF_CODE.fd","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1482025-01-22T01:36:27.101Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] checking for existing copy of artifact","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:27.136256536Z","target":"phd_framework::artifacts::store","line":89,"file":"phd-tests/framework/src/artifacts/store.rs","maybe_path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1492025-01-22T01:36:27.125Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Downloading alpine.iso from https://oxide-omicron-build.s3.amazonaws.com/alpine.iso","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:27.136430938Z","target":"phd_framework::artifacts::store","line":621,"file":"phd-tests/framework/src/artifacts/store.rs","timeout":"600s","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1502025-01-22T01:36:57.785Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.819981975Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1512025-01-22T01:36:57.809Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.820077896Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","verb":"list","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1522025-01-22T01:36:57.832Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.844780097Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 2.01M 1.80T 1.91M /phd-artifacts\n","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1532025-01-22T01:36:57.832Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.844924929Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-8e648c6f-d9fa-4bc7-a9b6-09713439f899\"]","verb":"snapshot","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1542025-01-22T01:36:57.869Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.903838947Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-8e648c6f-d9fa-4bc7-a9b6-09713439f899\", \"phd-artifacts/phd-clone-40d4570b-d352-48e3-8d2c-8b675cf0a009\"]","verb":"clone","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1552025-01-22T01:36:57.892Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.925053953Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-40d4570b-d352-48e3-8d2c-8b675cf0a009\"]","verb":"list","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1562025-01-22T01:36:57.916Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.936614991Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-40d4570b-d352-48e3-8d2c-8b675cf0a009 0B 1.80T 48.9M /phd-artifacts/phd-clone-40d4570b-d352-48e3-8d2c-8b675cf0a009\n","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1572025-01-22T01:36:57.916Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.937654821Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1582025-01-22T01:36:57.916Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.937735532Z","target":"phd_framework::test_vm","line":210,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__BASE_PROPOLIS\" }","vm_name":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1592025-01-22T01:36:57.916Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] checking for existing copy of artifact","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.937790563Z","target":"phd_framework::artifacts::store","line":89,"file":"phd-tests/framework/src/artifacts/store.rs","maybe_path":"/phd-artifacts/4fdf212b3ee741e3b94ce83958024b8bb1d7b141e0381895100e3552975fbc8a/propolis-server.tar.gz","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1602025-01-22T01:36:57.916Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:36:57.937846273Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","timeout":"600s","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/propolis/phd_build/6f40d5ea67ec684eca17385ea9496b5e851acde1/propolis-server.tar.gz","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1612025-01-22T01:37:21.967Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Extracting artifact from tarball","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:22.00133207Z","target":"phd_framework::artifacts::store","line":162,"file":"phd-tests/framework/src/artifacts/store.rs","untar_path":"propolis-server","extracted_path":"/phd-artifacts/4fdf212b3ee741e3b94ce83958024b8bb1d7b141e0381895100e3552975fbc8a/propolis-server","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1622025-01-22T01:37:21.990Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Extracting gzipped tarball...","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:22.001433651Z","target":"phd_framework::artifacts::store","line":521,"file":"phd-tests/framework/src/artifacts/store.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1632025-01-22T01:37:35.129Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.162995562Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","bootrom_path":"\"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd\"","server_addr":"127.0.0.1:9000","server_path":"\"/phd-artifacts/4fdf212b3ee741e3b94ce83958024b8bb1d7b141e0381895100e3552975fbc8a/propolis-server\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1642025-01-22T01:37:35.152Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.163125384Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_from_base_and_back.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_from_base_and_back.stderr.log\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1652025-01-22T01:37:35.188Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 867","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.222496487Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1662025-01-22T01:37:35.212Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.222891601Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":37285,"path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1672025-01-22T01:37:35.212Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.223100443Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1682025-01-22T01:37:35.212Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.223821081Z","target":"phd_framework::test_vm","line":319,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance)","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1692025-01-22T01:37:35.929Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.962860232Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
1702025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.96372443Z","target":"phd_framework::test_vm","line":379,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { properties: InstanceProperties { description: \"Pheidippides-managed VM\", id: dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef, metadata: InstanceMetadata { project_id: 9ee4ead4-bfc9-48c8-8c84-22f64601cb8d, silo_id: a4e8eb39-a014-4d67-9d34-b2d23127f5ae, sled_id: 4a53a70f-80e0-4fde-a174-3af9d09122b3, sled_model: \"pheidippes\", sled_revision: 1, sled_serial: \"4a53a70f-80e0-4fde-a174-3af9d09122b3\" }, name: \"phd-vm-dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef\" }, state: Creating }","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1712025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.963795471Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":740,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1722025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.963856792Z","target":"phd_framework::test_vm","line":440,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1732025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.963895682Z","target":"phd_framework::test_vm","line":445,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1742025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.964459818Z","target":"phd_framework::test_vm","line":440,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":0,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1752025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.964551069Z","target":"phd_framework::test_vm","line":724,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1762025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.964596429Z","target":"phd_framework::test_vm","line":673,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","timeout_duration":"300s","vm":"migration_from_base_and_back","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1772025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.96463197Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1782025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.96466737Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1792025-01-22T01:37:35.974Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:35.96470321Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1802025-01-22T01:37:40.210Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.242698788Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":4277,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1812025-01-22T01:37:40.210Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.242773788Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1822025-01-22T01:37:40.233Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.24299004Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1832025-01-22T01:37:40.233Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.243041211Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1842025-01-22T01:37:40.233Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.243077831Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1852025-01-22T01:37:40.233Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.261014763Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":17,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1862025-01-22T01:37:40.234Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.261163795Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"stty -F `tty` cols 9999\")","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1872025-01-22T01:37:40.234Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.261483488Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1882025-01-22T01:37:40.234Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.261534189Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1892025-01-22T01:37:40.234Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.261571429Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1902025-01-22T01:37:40.261Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.294373163Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":32,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1912025-01-22T01:37:40.285Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.294474324Z","target":"phd_framework::test_vm","line":721,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1922025-01-22T01:37:40.285Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.294535634Z","target":"phd_framework::test_vm","line":724,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4329,"path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1932025-01-22T01:37:40.285Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.294742736Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1942025-01-22T01:37:40.285Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.294824427Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"ls foo.bar 2> /dev/null","timeout_duration":"Explicit(15s)","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1952025-01-22T01:37:40.285Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.305128142Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":10,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1962025-01-22T01:37:40.285Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.305339084Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1972025-01-22T01:37:40.285Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.305420775Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1982025-01-22T01:37:40.310Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.338290239Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":32,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
1992025-01-22T01:37:40.310Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.338507991Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2002025-01-22T01:37:40.310Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.338588712Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"touch ./foo.bar","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2012025-01-22T01:37:40.333Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.349029448Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":10,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2022025-01-22T01:37:40.333Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.349297091Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2032025-01-22T01:37:40.334Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.349394302Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2042025-01-22T01:37:40.357Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.382327167Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":32,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2052025-01-22T01:37:40.357Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.382520398Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2062025-01-22T01:37:40.357Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.382574049Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"sync ./foo.bar","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2072025-01-22T01:37:40.381Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.392805413Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":10,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2082025-01-22T01:37:40.381Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.392938544Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2092025-01-22T01:37:40.381Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.392988025Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2102025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.414634665Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":21,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2112025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.414820387Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","vm_name":"migration_from_base_and_back","propolis_artifact":"__DEFAULT_PROPOLIS","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2122025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.414933168Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2132025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.415013559Z","target":"phd_framework::test_vm","line":210,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","vm_name":"migration_from_base_and_back_lifecycle_0","guest_os_kind":"Alpine","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2142025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Examining locally-sourced artifact","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.41509476Z","target":"phd_framework::artifacts::store","line":56,"file":"phd-tests/framework/src/artifacts/store.rs","sha256":"None","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2152025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Locally-sourced artifact is valid, caching its path","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.41514026Z","target":"phd_framework::artifacts::store","line":69,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2162025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.415186761Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_addr":"127.0.0.1:9002","server_path":"\"/work/phd-test/propolis-server\"","bootrom_path":"\"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2172025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.415223751Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stdout.log\"","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2182025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 868","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.437389996Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2192025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.437591178Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":22,"path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2202025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.437707329Z","target":"phd_framework::test_vm","line":474,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2212025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.43776629Z","target":"phd_framework::test_vm","line":507,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"45s","migration_id":"cccfc6f0-4da8-4769-8193-071e031737b5","target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2222025-01-22T01:37:40.405Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.437828471Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_0","target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","vm_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2232025-01-22T01:37:40.429Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:40.438294175Z","target":"phd_framework::test_vm","line":319,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance)","vm":"migration_from_base_and_back_lifecycle_0","target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","vm_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2242025-01-22T01:37:41.153Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:41.186462609Z","target":"phd_framework::test_vm","line":379,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { properties: InstanceProperties { description: \"Pheidippides-managed VM\", id: e7bf513a-722f-4b2a-8c9e-df796a28c312, metadata: InstanceMetadata { project_id: 9ee4ead4-bfc9-48c8-8c84-22f64601cb8d, silo_id: a4e8eb39-a014-4d67-9d34-b2d23127f5ae, sled_id: f1bed7bb-1aea-4f57-ad72-9eb577a71dff, sled_model: \"pheidippes\", sled_revision: 1, sled_serial: \"f1bed7bb-1aea-4f57-ad72-9eb577a71dff\" }, name: \"phd-vm-e7bf513a-722f-4b2a-8c9e-df796a28c312\" }, state: Migrating }","vm":"migration_from_base_and_back_lifecycle_0","target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","vm_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2252025-01-22T01:37:41.177Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:41.18658303Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_0","path":"phd_tests::migrate::from_base::migration_from_base_and_back","target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","vm_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","elapsed_milliseconds":748}
2262025-01-22T01:37:41.177Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:41.186646821Z","target":"phd_framework::test_vm","line":528,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","migration_id":"cccfc6f0-4da8-4769-8193-071e031737b5","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2272025-01-22T01:37:43.880Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Instance reported error during migration","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:43.913689376Z","target":"phd_framework::test_vm","line":545,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2282025-01-22T01:37:43.904Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:43.913796307Z","target":"phd_framework::test_vm","line":528,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":2727,"target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","migration_id":"cccfc6f0-4da8-4769-8193-071e031737b5","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2292025-01-22T01:37:43.904Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:43.913840867Z","target":"phd_framework::test_vm","line":474,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":3476,"target_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","target":"migration_from_base_and_back_lifecycle_0","source":"migration_from_base_and_back","source_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2302025-01-22T01:37:43.905Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:43.913935918Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_0","vm_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2312025-01-22T01:37:43.905Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:43.91405851Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2322025-01-22T01:37:43.905Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:43.915307452Z","target":"phd_framework::test_vm","line":1019,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_0","vm_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2332025-01-22T01:37:43.905Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:43.915822447Z","target":"phd_framework::test_vm","line":1019,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2342025-01-22T01:37:43.905Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:43.916241932Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm":"migration_from_base_and_back_lifecycle_0","vm_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2352025-01-22T01:37:44.001Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.034652175Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
2362025-01-22T01:37:44.047Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.034818657Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":8071}
2372025-01-22T01:37:44.047Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::from_base::migration_from_base_and_back ... FAILED: live migration\n\nCaused by:\n error during migration\n\nStack backtrace:\n 0: anyhow::error::<impl anyhow::Error>::msg\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.89/src/backtrace.rs:27:14\n 1: anyhow::__private::format_err\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.89/src/lib.rs:690:13\n 2: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:546:59\n 3: <backoff::future::Retry<S,B,N,Fn,Fut> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/backoff-0.4.0/src/future.rs:182:26\n 4: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:563:18\n 5: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.40/src/instrument.rs:321:9\n 6: phd_framework::test_vm::TestVm::migrate_from::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:474:5\n 7: phd_framework::lifecycle::<impl phd_framework::Framework>::lifecycle_test::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/lifecycle.rs:95:26\n 8: phd_tests::migrate::from_base::migration_from_base_and_back::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:83:10\n 9: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.40/src/instrument.rs:321:9\n 10: phd_tests::migrate::from_base::migration_from_base_and_back::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:52:5\n 11: <core::pin::Pin<P> as core::future::future::Future>::poll\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/future/future.rs:124:9\n 12: phd_testcase::TestCase::run::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/testcase/src/lib.rs:79:32\n 13: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/macros/select.rs:557:49\n 14: <tokio::future::poll_fn::PollFn<F> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/future/poll_fn.rs:58:9\n 15: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/runner/src/execute.rs:105:13\n 16: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:331:17\n 17: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/loom/std/unsafe_cell.rs:16:9\n 18: tokio::runtime::task::core::Core<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:320:13\n 19: tokio::runtime::task::harness::poll_future::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:500:19\n 20: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 21: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 22: __rust_try\n 23: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 24: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 25: tokio::runtime::task::harness::poll_future\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:488:18\n 26: tokio::runtime::task::harness::Harness<T,S>::poll_inner\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:209:27\n 27: tokio::runtime::task::harness::Harness<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:154:15\n 28: tokio::runtime::task::raw::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:271:5\n 29: tokio::runtime::task::raw::RawTask::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:201:18\n 30: tokio::runtime::task::LocalNotified<S>::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/mod.rs:436:9\n 31: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:661:17\n 32: tokio::runtime::coop::with_budget\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/coop.rs:107:5\n 33: tokio::runtime::coop::budget\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/coop.rs:73:5\n 34: tokio::runtime::scheduler::multi_thread::worker::Context::run_task\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:597:9\n 35: tokio::runtime::scheduler::multi_thread::worker::Context::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:548:24\n 36: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:513:21\n 37: tokio::runtime::context::scoped::Scoped<T>::set\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context/scoped.rs:40:9\n 38: tokio::runtime::context::set_scheduler::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context.rs:180:26\n 39: std::thread::local::LocalKey<T>::try_with\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/local.rs:283:12\n 40: std::thread::local::LocalKey<T>::with\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/local.rs:260:9\n 41: tokio::runtime::context::set_scheduler\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context.rs:180:9\n 42: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:508:9\n 43: tokio::runtime::context::runtime::enter_runtime\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context/runtime.rs:65:16\n 44: tokio::runtime::scheduler::multi_thread::worker::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:500:5\n 45: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:466:45\n 46: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/task.rs:42:21\n 47: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:331:17\n 48: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/loom/std/unsafe_cell.rs:16:9\n 49: tokio::runtime::task::core::Core<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:320:13\n 50: tokio::runtime::task::harness::poll_future::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:500:19\n 51: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 52: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 53: __rust_try\n 54: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 55: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 56: tokio::runtime::task::harness::poll_future\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:488:18\n 57: tokio::runtime::task::harness::Harness<T,S>::poll_inner\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:209:27\n 58: tokio::runtime::task::harness::Harness<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:154:15\n 59: tokio::runtime::task::raw::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:271:5\n 60: tokio::runtime::task::raw::RawTask::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:201:18\n 61: tokio::runtime::task::UnownedTask<S>::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/mod.rs:473:9\n 62: tokio::runtime::blocking::pool::Task::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:160:9\n 63: tokio::runtime::blocking::pool::Inner::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:518:17\n 64: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:476:13\n 65: std::sys::backtrace::__rust_begin_short_backtrace\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/sys/backtrace.rs:154:18\n 66: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/mod.rs:561:17\n 67: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 68: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 69: __rust_try\n 70: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 71: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 72: std::thread::Builder::spawn_unchecked_::{{closure}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/mod.rs:559:30\n 73: core::ops::function::FnOnce::call_once{{vtable.shim}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/ops/function.rs:250:5\n 74: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/alloc/src/boxed.rs:1972:9\n 75: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/alloc/src/boxed.rs:1972:9\n 76: std::sys::pal::unix::thread::Thread::new::thread_start\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/sys/pal/unix/thread.rs:105:17\n 77: _thrp_setup\n 78: <unknown>","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.034907408Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
2382025-01-22T01:37:44.047Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.034973628Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
2392025-01-22T01:37:44.047Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.036043879Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2402025-01-22T01:37:44.071Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.058611238Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back_lifecycle_0","elapsed_milliseconds":144,"vm_id":"e7bf513a-722f-4b2a-8c9e-df796a28c312","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2412025-01-22T01:37:44.130Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.163125931Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2422025-01-22T01:37:44.153Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.163207932Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-40d4570b-d352-48e3-8d2c-8b675cf0a009\"]","verb":"destroy","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2432025-01-22T01:37:44.177Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.209106098Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2442025-01-22T01:37:44.177Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.209165039Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-8e648c6f-d9fa-4bc7-a9b6-09713439f899\"]","vm":"migration_from_base_and_back","vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2452025-01-22T01:37:44.209Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.242417957Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_and_back","elapsed_milliseconds":328,"vm_id":"dcbfbe5a-4358-4728-9d4e-4f6fc04c54ef","path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2462025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.242468427Z","target":"phd_tests::migrate::from_base","line":52,"file":"phd-tests/tests/src/migrate.rs","elapsed_milliseconds":77703,"path":"phd_tests::migrate::from_base::migration_from_base_and_back"}
2472025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.242665529Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":207}
2482025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::from_base::serial_history","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.24272238Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
2492025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.24275206Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
2502025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.24277951Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
2512025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.242888951Z","target":"phd_tests::migrate::from_base","line":40,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::serial_history"}
2522025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.242972492Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::from_base::serial_history"}
2532025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.243020533Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::serial_history"}
2542025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.243067323Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::serial_history"}
2552025-01-22T01:37:44.233Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.243113964Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::from_base::serial_history"}
2562025-01-22T01:37:44.256Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.26639691Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 684M 1.80T 684M /phd-artifacts\n","path":"phd_tests::migrate::from_base::serial_history"}
2572025-01-22T01:37:44.257Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.266488581Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-d18122a7-0dff-4db8-9805-47f62dbf09e4\"]","path":"phd_tests::migrate::from_base::serial_history"}
2582025-01-22T01:37:44.280Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.294459886Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"clone","args":"[\"phd-artifacts@phd-d18122a7-0dff-4db8-9805-47f62dbf09e4\", \"phd-artifacts/phd-clone-33906e8c-deaa-4daf-9814-1f05d9379b88\"]","path":"phd_tests::migrate::from_base::serial_history"}
2592025-01-22T01:37:44.304Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.321603771Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"phd-artifacts/phd-clone-33906e8c-deaa-4daf-9814-1f05d9379b88\"]","path":"phd_tests::migrate::from_base::serial_history"}
2602025-01-22T01:37:44.327Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.339961798Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-33906e8c-deaa-4daf-9814-1f05d9379b88 0B 1.80T 684M /phd-artifacts/phd-clone-33906e8c-deaa-4daf-9814-1f05d9379b88\n","path":"phd_tests::migrate::from_base::serial_history"}
2612025-01-22T01:37:44.327Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.340518754Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history"}
2622025-01-22T01:37:44.327Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.340574284Z","target":"phd_framework::test_vm","line":210,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__BASE_PROPOLIS\" }","vm_name":"migration_serial_history_base","guest_os_kind":"Alpine","path":"phd_tests::migrate::from_base::serial_history"}
2632025-01-22T01:37:44.328Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.340629325Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/4fdf212b3ee741e3b94ce83958024b8bb1d7b141e0381895100e3552975fbc8a/propolis-server","path":"phd_tests::migrate::from_base::serial_history"}
2642025-01-22T01:37:44.328Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.340681875Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/phd-artifacts/4fdf212b3ee741e3b94ce83958024b8bb1d7b141e0381895100e3552975fbc8a/propolis-server\"","bootrom_path":"\"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd\"","server_addr":"127.0.0.1:9000","path":"phd_tests::migrate::from_base::serial_history"}
2652025-01-22T01:37:44.328Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.340724106Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_serial_history_base.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_serial_history_base.stdout.log\"","path":"phd_tests::migrate::from_base::serial_history"}
2662025-01-22T01:37:44.328Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 877","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.353318404Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::serial_history"}
2672025-01-22T01:37:44.328Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.353558456Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":12}
2682025-01-22T01:37:44.328Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.353661157Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2692025-01-22T01:37:44.328Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:44.354251713Z","target":"phd_framework::test_vm","line":319,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance)","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2702025-01-22T01:37:45.143Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.175757572Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
2712025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.176093645Z","target":"phd_framework::test_vm","line":379,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { properties: InstanceProperties { description: \"Pheidippides-managed VM\", id: 03b34047-2ae6-4024-8ed2-3c467c85c642, metadata: InstanceMetadata { project_id: 01597209-df90-4696-a7a1-705cbbd0f505, silo_id: efbd7e02-8b19-4e84-8deb-0c142db77ab5, sled_id: 19b44d94-3469-4a60-b457-89ee605b63a4, sled_model: \"pheidippes\", sled_revision: 1, sled_serial: \"19b44d94-3469-4a60-b457-89ee605b63a4\" }, name: \"phd-vm-03b34047-2ae6-4024-8ed2-3c467c85c642\" }, state: Creating }","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2722025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.176157416Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":822,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2732025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.176201236Z","target":"phd_framework::test_vm","line":440,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2742025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.176236277Z","target":"phd_framework::test_vm","line":445,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2752025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.176926904Z","target":"phd_framework::test_vm","line":440,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":0,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2762025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.177020005Z","target":"phd_framework::test_vm","line":724,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history"}
2772025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.177111656Z","target":"phd_framework::test_vm","line":673,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"300s","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","vm":"migration_serial_history_base","path":"phd_tests::migrate::from_base::serial_history"}
2782025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.177156246Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::from_base::serial_history"}
2792025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.177200126Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2802025-01-22T01:37:45.188Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:45.177241157Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"CallerTimeout","target":"localhost login: ","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2812025-01-22T01:37:49.344Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.376558125Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":4199,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2822025-01-22T01:37:49.344Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.376632536Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::from_base::serial_history"}
2832025-01-22T01:37:49.368Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.376868458Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::serial_history"}
2842025-01-22T01:37:49.368Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.376918788Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2852025-01-22T01:37:49.368Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.376953179Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2862025-01-22T01:37:49.368Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.393903291Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":16,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2872025-01-22T01:37:49.368Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.394016562Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"stty -F `tty` cols 9999\")","path":"phd_tests::migrate::from_base::serial_history"}
2882025-01-22T01:37:49.368Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.394372536Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::serial_history"}
2892025-01-22T01:37:49.368Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.394480577Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2902025-01-22T01:37:49.368Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.394560868Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2912025-01-22T01:37:49.394Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.427166689Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":32,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2922025-01-22T01:37:49.418Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.42725671Z","target":"phd_framework::test_vm","line":721,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history"}
2932025-01-22T01:37:49.418Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.427317691Z","target":"phd_framework::test_vm","line":724,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":4250}
2942025-01-22T01:37:49.418Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.427522153Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2952025-01-22T01:37:49.418Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.427603844Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"echo hello from the source VM!","timeout_duration":"Explicit(15s)","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2962025-01-22T01:37:49.418Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.437973239Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":10,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2972025-01-22T01:37:49.418Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.438185501Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2982025-01-22T01:37:49.418Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.438254992Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
2992025-01-22T01:37:49.441Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.471033745Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":32,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3002025-01-22T01:37:49.465Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.476249418Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","vm_name":"migration_serial_history_base","propolis_artifact":"__DEFAULT_PROPOLIS","path":"phd_tests::migrate::from_base::serial_history"}
3012025-01-22T01:37:49.465Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.476327309Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history"}
3022025-01-22T01:37:49.465Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.476374909Z","target":"phd_framework::test_vm","line":210,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_name":"migration_serial_history_base_lifecycle_0","guest_os_kind":"Alpine","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::migrate::from_base::serial_history"}
3032025-01-22T01:37:49.465Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.47642469Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::from_base::serial_history"}
3042025-01-22T01:37:49.465Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.47646675Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","bootrom_path":"\"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd\"","server_addr":"127.0.0.1:9002","path":"phd_tests::migrate::from_base::serial_history"}
3052025-01-22T01:37:49.465Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.476505601Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stderr.log\"","path":"phd_tests::migrate::from_base::serial_history"}
3062025-01-22T01:37:49.466Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 878","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.494556574Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::serial_history"}
3072025-01-22T01:37:49.466Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.494737756Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":18}
3082025-01-22T01:37:49.466Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.494830507Z","target":"phd_framework::test_vm","line":474,"file":"phd-tests/framework/src/test_vm/mod.rs","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0"}
3092025-01-22T01:37:49.466Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.494885798Z","target":"phd_framework::test_vm","line":507,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"45s","migration_id":"afcc614c-af5a-4c90-b2de-ea75a0708f14","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0"}
3102025-01-22T01:37:49.466Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.494951848Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","vm_id":"21e0917c-969b-454c-9d9a-c389f8490000","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0","vm":"migration_serial_history_base_lifecycle_0"}
3112025-01-22T01:37:49.466Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:49.495359092Z","target":"phd_framework::test_vm","line":319,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance)","vm_id":"21e0917c-969b-454c-9d9a-c389f8490000","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0","vm":"migration_serial_history_base_lifecycle_0"}
3122025-01-22T01:37:50.102Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:50.135288706Z","target":"phd_framework::test_vm","line":379,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { properties: InstanceProperties { description: \"Pheidippides-managed VM\", id: 21e0917c-969b-454c-9d9a-c389f8490000, metadata: InstanceMetadata { project_id: 01597209-df90-4696-a7a1-705cbbd0f505, silo_id: efbd7e02-8b19-4e84-8deb-0c142db77ab5, sled_id: 0732157f-77f1-472f-9ed9-2f4fd31e5322, sled_model: \"pheidippes\", sled_revision: 1, sled_serial: \"0732157f-77f1-472f-9ed9-2f4fd31e5322\" }, name: \"phd-vm-21e0917c-969b-454c-9d9a-c389f8490000\" }, state: Migrating }","vm_id":"21e0917c-969b-454c-9d9a-c389f8490000","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0","vm":"migration_serial_history_base_lifecycle_0"}
3132025-01-22T01:37:50.126Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:50.135392187Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","path":"phd_tests::migrate::from_base::serial_history","vm_id":"21e0917c-969b-454c-9d9a-c389f8490000","vm":"migration_serial_history_base_lifecycle_0","elapsed_milliseconds":640,"source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","target":"migration_serial_history_base_lifecycle_0"}
3142025-01-22T01:37:50.126Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:50.135452177Z","target":"phd_framework::test_vm","line":528,"file":"phd-tests/framework/src/test_vm/mod.rs","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","migration_id":"afcc614c-af5a-4c90-b2de-ea75a0708f14","source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0"}
3152025-01-22T01:37:53.401Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Instance reported error during migration","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.433605227Z","target":"phd_framework::test_vm","line":545,"file":"phd-tests/framework/src/test_vm/mod.rs","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0"}
3162025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.433768228Z","target":"phd_framework::test_vm","line":528,"file":"phd-tests/framework/src/test_vm/mod.rs","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","migration_id":"afcc614c-af5a-4c90-b2de-ea75a0708f14","source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0","elapsed_milliseconds":3298}
3172025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.433812279Z","target":"phd_framework::test_vm","line":474,"file":"phd-tests/framework/src/test_vm/mod.rs","source":"migration_serial_history_base","target_id":"21e0917c-969b-454c-9d9a-c389f8490000","elapsed_milliseconds":3938,"source_id":"03b34047-2ae6-4024-8ed2-3c467c85c642","path":"phd_tests::migrate::from_base::serial_history","target":"migration_serial_history_base_lifecycle_0"}
3182025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.43389049Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0","vm_id":"21e0917c-969b-454c-9d9a-c389f8490000"}
3192025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.43398172Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3202025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.435093912Z","target":"phd_framework::test_vm","line":1019,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3212025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.435312404Z","target":"phd_framework::test_vm","line":1019,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0","vm_id":"21e0917c-969b-454c-9d9a-c389f8490000"}
3222025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.435427115Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
3232025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.435526466Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":8259}
3242025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::from_base::serial_history ... FAILED: live migration\n\nCaused by:\n error during migration\n\nStack backtrace:\n 0: anyhow::error::<impl anyhow::Error>::msg\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.89/src/backtrace.rs:27:14\n 1: anyhow::__private::format_err\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.89/src/lib.rs:690:13\n 2: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:546:59\n 3: <backoff::future::Retry<S,B,N,Fn,Fut> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/backoff-0.4.0/src/future.rs:182:26\n 4: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:563:18\n 5: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.40/src/instrument.rs:321:9\n 6: phd_framework::test_vm::TestVm::migrate_from::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:474:5\n 7: phd_framework::lifecycle::<impl phd_framework::Framework>::lifecycle_test::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/lifecycle.rs:95:26\n 8: phd_tests::migrate::run_serial_history_test::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:358:6\n 9: phd_tests::migrate::from_base::serial_history::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:46:10\n 10: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.40/src/instrument.rs:321:9\n 11: phd_tests::migrate::from_base::serial_history::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:40:5\n 12: <core::pin::Pin<P> as core::future::future::Future>::poll\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/future/future.rs:124:9\n 13: phd_testcase::TestCase::run::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/testcase/src/lib.rs:79:32\n 14: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/macros/select.rs:557:49\n 15: <tokio::future::poll_fn::PollFn<F> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/future/poll_fn.rs:58:9\n 16: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/runner/src/execute.rs:105:13\n 17: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:331:17\n 18: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/loom/std/unsafe_cell.rs:16:9\n 19: tokio::runtime::task::core::Core<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:320:13\n 20: tokio::runtime::task::harness::poll_future::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:500:19\n 21: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 22: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 23: __rust_try\n 24: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 25: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 26: tokio::runtime::task::harness::poll_future\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:488:18\n 27: tokio::runtime::task::harness::Harness<T,S>::poll_inner\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:209:27\n 28: tokio::runtime::task::harness::Harness<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:154:15\n 29: tokio::runtime::task::raw::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:271:5\n 30: tokio::runtime::task::raw::RawTask::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:201:18\n 31: tokio::runtime::task::LocalNotified<S>::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/mod.rs:436:9\n 32: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:661:17\n 33: tokio::runtime::coop::with_budget\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/coop.rs:107:5\n 34: tokio::runtime::coop::budget\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/coop.rs:73:5\n 35: tokio::runtime::scheduler::multi_thread::worker::Context::run_task\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:597:9\n 36: tokio::runtime::scheduler::multi_thread::worker::Context::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:548:24\n 37: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:513:21\n 38: tokio::runtime::context::scoped::Scoped<T>::set\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context/scoped.rs:40:9\n 39: tokio::runtime::context::set_scheduler::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context.rs:180:26\n 40: std::thread::local::LocalKey<T>::try_with\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/local.rs:283:12\n 41: std::thread::local::LocalKey<T>::with\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/local.rs:260:9\n 42: tokio::runtime::context::set_scheduler\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context.rs:180:9\n 43: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:508:9\n 44: tokio::runtime::context::runtime::enter_runtime\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context/runtime.rs:65:16\n 45: tokio::runtime::scheduler::multi_thread::worker::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:500:5\n 46: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:466:45\n 47: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/task.rs:42:21\n 48: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:331:17\n 49: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/loom/std/unsafe_cell.rs:16:9\n 50: tokio::runtime::task::core::Core<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:320:13\n 51: tokio::runtime::task::harness::poll_future::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:500:19\n 52: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 53: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 54: __rust_try\n 55: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 56: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 57: tokio::runtime::task::harness::poll_future\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:488:18\n 58: tokio::runtime::task::harness::Harness<T,S>::poll_inner\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:209:27\n 59: tokio::runtime::task::harness::Harness<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:154:15\n 60: tokio::runtime::task::raw::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:271:5\n 61: tokio::runtime::task::raw::RawTask::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:201:18\n 62: tokio::runtime::task::UnownedTask<S>::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/mod.rs:473:9\n 63: tokio::runtime::blocking::pool::Task::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:160:9\n 64: tokio::runtime::blocking::pool::Inner::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:518:17\n 65: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:476:13\n 66: std::sys::backtrace::__rust_begin_short_backtrace\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/sys/backtrace.rs:154:18\n 67: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/mod.rs:561:17\n 68: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 69: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 70: __rust_try\n 71: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 72: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 73: std::thread::Builder::spawn_unchecked_::{{closure}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/mod.rs:559:30\n 74: core::ops::function::FnOnce::call_once{{vtable.shim}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/ops/function.rs:250:5\n 75: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/alloc/src/boxed.rs:1972:9\n 76: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/alloc/src/boxed.rs:1972:9\n 77: std::sys::pal::unix::thread::Thread::new::thread_start\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/sys/pal/unix/thread.rs:105:17\n 78: _thrp_setup\n 79: <unknown>","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.435753098Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
3252025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.435816159Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
3262025-01-22T01:37:53.468Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.436051352Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0","vm_id":"21e0917c-969b-454c-9d9a-c389f8490000"}
3272025-01-22T01:37:53.547Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.580477719Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":146,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base_lifecycle_0","vm_id":"21e0917c-969b-454c-9d9a-c389f8490000"}
3282025-01-22T01:37:53.808Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.840845806Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3292025-01-22T01:37:53.940Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.972770906Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3302025-01-22T01:37:53.963Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:53.972863397Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-33906e8c-deaa-4daf-9814-1f05d9379b88\"]","verb":"destroy","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3312025-01-22T01:37:53.987Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.018529281Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3322025-01-22T01:37:53.987Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.018594382Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"destroy","args":"[\"phd-artifacts@phd-d18122a7-0dff-4db8-9805-47f62dbf09e4\"]","path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3332025-01-22T01:37:54.019Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.052254174Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","elapsed_milliseconds":618,"path":"phd_tests::migrate::from_base::serial_history","vm":"migration_serial_history_base","vm_id":"03b34047-2ae6-4024-8ed2-3c467c85c642"}
3342025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.052304524Z","target":"phd_tests::migrate::from_base","line":40,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::serial_history","elapsed_milliseconds":9809}
3352025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.052588417Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":616}
3362025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"Starting test phd_tests::migrate::from_base::can_migrate_from_base","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.052673248Z","target":"phd_runner::execute","line":90,"file":"phd-tests/runner/src/execute.rs"}
3372025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.052710128Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs"}
3382025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST_SETUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.052742469Z","target":"phd_runner::fixtures","line":41,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
3392025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.052934751Z","target":"phd_tests::migrate::from_base","line":34,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3402025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.053022771Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3412025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.053073132Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3422025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.053120272Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3432025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.053163583Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"list","args":"[\"/phd-artifacts/ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1/alpine.iso\"]","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3442025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.073027775Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts 685M 1.80T 684M /phd-artifacts\n","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3452025-01-22T01:37:54.043Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.073107516Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","verb":"snapshot","args":"[\"phd-artifacts@phd-0b5da7eb-3c40-4a1a-890a-28786da481e3\"]","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3462025-01-22T01:37:54.069Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.102321243Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-0b5da7eb-3c40-4a1a-890a-28786da481e3\", \"phd-artifacts/phd-clone-b217355b-6cad-4b58-a6f3-b9143cc91f0b\"]","verb":"clone","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3472025-01-22T01:37:54.099Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.132070635Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-b217355b-6cad-4b58-a6f3-b9143cc91f0b\"]","verb":"list","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3482025-01-22T01:37:54.122Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] parsing zfs list output","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.150149859Z","target":"phd_framework::zfs","line":238,"file":"phd-tests/framework/src/zfs.rs","stdout":"NAME USED AVAIL REFER MOUNTPOINT\nphd-artifacts/phd-clone-b217355b-6cad-4b58-a6f3-b9143cc91f0b 0B 1.80T 684M /phd-artifacts/phd-clone-b217355b-6cad-4b58-a6f3-b9143cc91f0b\n","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3492025-01-22T01:37:54.123Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.150739115Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3502025-01-22T01:37:54.123Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.150798785Z","target":"phd_framework::test_vm","line":210,"file":"phd-tests/framework/src/test_vm/mod.rs","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__BASE_PROPOLIS\" }","guest_os_kind":"Alpine","vm_name":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3512025-01-22T01:37:54.123Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.150846226Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/phd-artifacts/4fdf212b3ee741e3b94ce83958024b8bb1d7b141e0381895100e3552975fbc8a/propolis-server","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3522025-01-22T01:37:54.123Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.150902666Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/phd-artifacts/4fdf212b3ee741e3b94ce83958024b8bb1d7b141e0381895100e3552975fbc8a/propolis-server\"","bootrom_path":"\"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd\"","server_addr":"127.0.0.1:9000","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3532025-01-22T01:37:54.123Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.150945547Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stdout_path":"\"/tmp/propolis-phd/migration_from_base.stdout.log\"","stderr_path":"\"/tmp/propolis-phd/migration_from_base.stderr.log\"","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3542025-01-22T01:37:54.147Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 887","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.162181271Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3552025-01-22T01:37:54.147Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.162383363Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base","elapsed_milliseconds":11}
3562025-01-22T01:37:54.147Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.162464824Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3572025-01-22T01:37:54.147Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.162982439Z","target":"phd_framework::test_vm","line":319,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9000/instance)","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3582025-01-22T01:37:54.794Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.826734865Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs"}
3592025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.82725398Z","target":"phd_framework::test_vm","line":379,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { properties: InstanceProperties { description: \"Pheidippides-managed VM\", id: 6430b126-aabd-405f-8692-c78530fccd35, metadata: InstanceMetadata { project_id: e6092e6c-bbc8-4e15-a329-b389bc17b3fd, silo_id: b3162727-2bd7-4316-84b1-4067be25c202, sled_id: b1c1a7ec-fcfd-4b54-b6b0-e8ac071902a0, sled_model: \"pheidippes\", sled_revision: 1, sled_serial: \"b1c1a7ec-fcfd-4b54-b6b0-e8ac071902a0\" }, name: \"phd-vm-6430b126-aabd-405f-8692-c78530fccd35\" }, state: Creating }","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3602025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.827331391Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":664,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3612025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.827395512Z","target":"phd_framework::test_vm","line":440,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3622025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - EVENT] Requesting instance state change","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.827436652Z","target":"phd_framework::test_vm","line":445,"file":"phd-tests/framework/src/test_vm/mod.rs","state":"Run","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3632025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[PUT_INSTANCE_STATE - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.827988898Z","target":"phd_framework::test_vm","line":440,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":0,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3642025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.828054138Z","target":"phd_framework::test_vm","line":724,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3652025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] waiting for guest to boot","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.828095359Z","target":"phd_framework::test_vm","line":673,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"300s","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3662025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.828128829Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost login: \")","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3672025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.82816124Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3682025-01-22T01:37:54.839Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:54.82819957Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost login: ","timeout_duration":"CallerTimeout","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3692025-01-22T01:37:59.036Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.068814617Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":4240,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3702025-01-22T01:37:59.036Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.068895488Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"root\")","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3712025-01-22T01:37:59.060Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.06906214Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3722025-01-22T01:37:59.060Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.06911328Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3732025-01-22T01:37:59.060Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.06914841Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3742025-01-22T01:37:59.061Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.088118483Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":18,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3752025-01-22T01:37:59.061Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.088249335Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WriteStr(\"stty -F `tty` cols 9999\")","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3762025-01-22T01:37:59.061Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] executing command in boot sequence","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.088640739Z","target":"phd_framework::test_vm","line":681,"file":"phd-tests/framework/src/test_vm/mod.rs","step":"WaitFor(\"localhost:~#\")","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3772025-01-22T01:37:59.061Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.08876509Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3782025-01-22T01:37:59.061Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.08882445Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"CallerTimeout","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3792025-01-22T01:37:59.089Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.121575814Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":32,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3802025-01-22T01:37:59.112Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - EVENT] Guest has booted","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.121677864Z","target":"phd_framework::test_vm","line":721,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3812025-01-22T01:37:59.112Z{"v":0,"name":"phd-runner","msg":"[WAIT_TO_BOOT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.121742325Z","target":"phd_framework::test_vm","line":724,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base","elapsed_milliseconds":4293}
3822025-01-22T01:37:59.112Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.121948947Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3832025-01-22T01:37:59.112Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.122030098Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"ls foo.bar 2> /dev/null","timeout_duration":"Explicit(15s)","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3842025-01-22T01:37:59.112Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.133453284Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":11,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3852025-01-22T01:37:59.112Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.133698547Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3862025-01-22T01:37:59.112Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.133777618Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3872025-01-22T01:37:59.136Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.156263926Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":22,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3882025-01-22T01:37:59.136Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.156394517Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3892025-01-22T01:37:59.136Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.156472808Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(15s)","target":"touch ./foo.bar","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3902025-01-22T01:37:59.136Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.166913404Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":10,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3912025-01-22T01:37:59.136Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.167138657Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3922025-01-22T01:37:59.136Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.167224587Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","timeout_duration":"Explicit(300s)","target":"localhost:~#","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3932025-01-22T01:37:59.167Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.200179412Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":32,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3942025-01-22T01:37:59.191Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.200456875Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3952025-01-22T01:37:59.191Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.200507936Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"sync ./foo.bar","timeout_duration":"Explicit(15s)","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3962025-01-22T01:37:59.191Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.210867881Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":10,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3972025-01-22T01:37:59.191Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.211118104Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3982025-01-22T01:37:59.191Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - EVENT] Waiting for output on serial console","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.211202374Z","target":"phd_framework::test_vm","line":746,"file":"phd-tests/framework/src/test_vm/mod.rs","target":"localhost:~#","timeout_duration":"Explicit(300s)","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
3992025-01-22T01:37:59.215Z{"v":0,"name":"phd-runner","msg":"[WAIT_FOR_SERIAL_OUTPUT - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.243982378Z","target":"phd_framework::test_vm","line":739,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":32,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4002025-01-22T01:37:59.215Z{"v":0,"name":"phd-runner","msg":"[TEST - EVENT] migrating to new Propolis artifact for lifecycle test","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.244060868Z","target":"phd_framework::lifecycle","line":74,"file":"phd-tests/framework/src/lifecycle.rs","vm_name":"migration_from_base","propolis_artifact":"__DEFAULT_PROPOLIS","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4012025-01-22T01:37:59.215Z{"v":0,"name":"phd-runner","msg":"[NEW - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.244131889Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4022025-01-22T01:37:59.215Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] phd_framework::test_vm","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.2441962Z","target":"phd_framework::test_vm","line":210,"file":"phd-tests/framework/src/test_vm/mod.rs","guest_os_kind":"Alpine","vm_name":"migration_from_base_lifecycle_0","environment":"EnvironmentSpec { location: Local, propolis_artifact: \"__DEFAULT_PROPOLIS\" }","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4032025-01-22T01:37:59.215Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Verified artifact already exists","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.2442573Z","target":"phd_framework::artifacts::store","line":45,"file":"phd-tests/framework/src/artifacts/store.rs","path":"/work/phd-test/propolis-server","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4042025-01-22T01:37:59.215Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launching Propolis server","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.244308691Z","target":"phd_framework::test_vm::server","line":55,"file":"phd-tests/framework/src/test_vm/server.rs","server_path":"\"/work/phd-test/propolis-server\"","server_addr":"127.0.0.1:9002","bootrom_path":"\"/phd-artifacts/29813374b58e3b77fb665f2d95cb3bab37d44fdd2c4fce2a70de9d76a3512a4f/OVMF_CODE.fd\"","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4052025-01-22T01:37:59.215Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Opening server log files","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.244354041Z","target":"phd_framework::server_log_mode","line":64,"file":"phd-tests/framework/src/server_log_mode.rs","stderr_path":"\"/tmp/propolis-phd/migration_from_base_lifecycle_0.stderr.log\"","stdout_path":"\"/tmp/propolis-phd/migration_from_base_lifecycle_0.stdout.log\"","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4062025-01-22T01:37:59.239Z{"v":0,"name":"phd-runner","msg":"[NEW - EVENT] Launched server with pid 888","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.267366215Z","target":"phd_framework::test_vm::server","line":107,"file":"phd-tests/framework/src/test_vm/server.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4072025-01-22T01:37:59.239Z{"v":0,"name":"phd-runner","msg":"[NEW - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.267676458Z","target":"phd_framework::test_vm","line":192,"file":"phd-tests/framework/src/test_vm/mod.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base","elapsed_milliseconds":23}
4082025-01-22T01:37:59.239Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.26781073Z","target":"phd_framework::test_vm","line":474,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4092025-01-22T01:37:59.239Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Migrating from source at address 127.0.0.1:9000","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.26790361Z","target":"phd_framework::test_vm","line":507,"file":"phd-tests/framework/src/test_vm/mod.rs","migration_id":"cb13763a-4ab5-4aad-8ff8-48903d450e96","timeout_duration":"45s","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4102025-01-22T01:37:59.239Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.268003462Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","vm":"migration_from_base_lifecycle_0","vm_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4112025-01-22T01:37:59.239Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] retriable error from instance_spec_ensure","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.268606738Z","target":"phd_framework::test_vm","line":319,"file":"phd-tests/framework/src/test_vm/mod.rs","e":"Communication Error: error sending request for url (http://127.0.0.1:9002/instance)","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","vm":"migration_from_base_lifecycle_0","vm_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4122025-01-22T01:37:59.918Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - EVENT] Started instance","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.951028583Z","target":"phd_framework::test_vm","line":379,"file":"phd-tests/framework/src/test_vm/mod.rs","instance_description.instance":"Instance { properties: InstanceProperties { description: \"Pheidippides-managed VM\", id: 8fc456a4-ee81-447f-b3e6-5d909a448159, metadata: InstanceMetadata { project_id: e6092e6c-bbc8-4e15-a329-b389bc17b3fd, silo_id: b3162727-2bd7-4316-84b1-4067be25c202, sled_id: 234cdbdb-bf64-4fd2-803e-060357b7d241, sled_model: \"pheidippes\", sled_revision: 1, sled_serial: \"234cdbdb-bf64-4fd2-803e-060357b7d241\" }, name: \"phd-vm-8fc456a4-ee81-447f-b3e6-5d909a448159\" }, state: Migrating }","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","vm":"migration_from_base_lifecycle_0","vm_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4132025-01-22T01:37:59.942Z{"v":0,"name":"phd-runner","msg":"[INSTANCE_ENSURE_INTERNAL - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.951133834Z","target":"phd_framework::test_vm","line":275,"file":"phd-tests/framework/src/test_vm/mod.rs","source":"migration_from_base","elapsed_milliseconds":683,"vm_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","vm":"migration_from_base_lifecycle_0","target":"migration_from_base_lifecycle_0","source_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4142025-01-22T01:37:59.942Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:37:59.951186835Z","target":"phd_framework::test_vm","line":528,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","migration_id":"cb13763a-4ab5-4aad-8ff8-48903d450e96","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4152025-01-22T01:38:03.191Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - EVENT] Instance reported error during migration","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.223658003Z","target":"phd_framework::test_vm","line":545,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4162025-01-22T01:38:03.258Z{"v":0,"name":"phd-runner","msg":"[MIGRATE - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.223778794Z","target":"phd_framework::test_vm","line":528,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","migration_id":"cb13763a-4ab5-4aad-8ff8-48903d450e96","elapsed_milliseconds":3272,"path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4172025-01-22T01:38:03.258Z{"v":0,"name":"phd-runner","msg":"[MIGRATE_FROM - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.223824725Z","target":"phd_framework::test_vm","line":474,"file":"phd-tests/framework/src/test_vm/mod.rs","target_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","target":"migration_from_base_lifecycle_0","source":"migration_from_base","elapsed_milliseconds":3955,"path":"phd_tests::migrate::from_base::can_migrate_from_base","source_id":"6430b126-aabd-405f-8692-c78530fccd35"}
4182025-01-22T01:38:03.258Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.223895005Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_lifecycle_0","vm_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4192025-01-22T01:38:03.258Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.224001006Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4202025-01-22T01:38:03.258Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - EVENT] serial console command channel was closed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.224812055Z","target":"phd_framework::serial","line":213,"file":"phd-tests/framework/src/serial/mod.rs"}
4212025-01-22T01:38:03.258Z{"v":0,"name":"phd-runner","msg":"[SERIAL CONSOLE TASK - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.224923236Z","target":"phd_framework::serial","line":200,"file":"phd-tests/framework/src/serial/mod.rs","elapsed_milliseconds":8398}
4222025-01-22T01:38:03.258Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.225053237Z","target":"phd_framework::test_vm","line":1019,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_lifecycle_0","vm_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4232025-01-22T01:38:03.258Z{"v":0,"name":"phd-runner","msg":"test phd_tests::migrate::from_base::can_migrate_from_base ... FAILED: live migration\n\nCaused by:\n error during migration\n\nStack backtrace:\n 0: anyhow::error::<impl anyhow::Error>::msg\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.89/src/backtrace.rs:27:14\n 1: anyhow::__private::format_err\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.89/src/lib.rs:690:13\n 2: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:546:59\n 3: <backoff::future::Retry<S,B,N,Fn,Fut> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/backoff-0.4.0/src/future.rs:182:26\n 4: phd_framework::test_vm::TestVm::migrate_from::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:563:18\n 5: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.40/src/instrument.rs:321:9\n 6: phd_framework::test_vm::TestVm::migrate_from::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/test_vm/mod.rs:474:5\n 7: phd_framework::lifecycle::<impl phd_framework::Framework>::lifecycle_test::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/framework/src/lifecycle.rs:95:26\n 8: phd_tests::migrate::run_smoke_test::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:320:6\n 9: phd_tests::migrate::from_base::can_migrate_from_base::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:37:14\n 10: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.40/src/instrument.rs:321:9\n 11: phd_tests::migrate::from_base::can_migrate_from_base::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/tests/src/migrate.rs:34:5\n 12: <core::pin::Pin<P> as core::future::future::Future>::poll\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/future/future.rs:124:9\n 13: phd_testcase::TestCase::run::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/testcase/src/lib.rs:79:32\n 14: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/macros/select.rs:557:49\n 15: <tokio::future::poll_fn::PollFn<F> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/future/poll_fn.rs:58:9\n 16: phd_runner::execute::run_tests_with_ctx::{{closure}}::{{closure}}\n at ./oxidecomputer/propolis/phd-tests/runner/src/execute.rs:105:13\n 17: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:331:17\n 18: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/loom/std/unsafe_cell.rs:16:9\n 19: tokio::runtime::task::core::Core<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:320:13\n 20: tokio::runtime::task::harness::poll_future::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:500:19\n 21: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 22: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 23: __rust_try\n 24: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 25: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 26: tokio::runtime::task::harness::poll_future\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:488:18\n 27: tokio::runtime::task::harness::Harness<T,S>::poll_inner\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:209:27\n 28: tokio::runtime::task::harness::Harness<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:154:15\n 29: tokio::runtime::task::raw::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:271:5\n 30: tokio::runtime::task::raw::RawTask::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:201:18\n 31: tokio::runtime::task::LocalNotified<S>::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/mod.rs:436:9\n 32: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:661:17\n 33: tokio::runtime::coop::with_budget\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/coop.rs:107:5\n 34: tokio::runtime::coop::budget\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/coop.rs:73:5\n 35: tokio::runtime::scheduler::multi_thread::worker::Context::run_task\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:597:9\n 36: tokio::runtime::scheduler::multi_thread::worker::Context::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:548:24\n 37: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:513:21\n 38: tokio::runtime::context::scoped::Scoped<T>::set\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context/scoped.rs:40:9\n 39: tokio::runtime::context::set_scheduler::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context.rs:180:26\n 40: std::thread::local::LocalKey<T>::try_with\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/local.rs:283:12\n 41: std::thread::local::LocalKey<T>::with\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/local.rs:260:9\n 42: tokio::runtime::context::set_scheduler\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context.rs:180:9\n 43: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:508:9\n 44: tokio::runtime::context::runtime::enter_runtime\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/context/runtime.rs:65:16\n 45: tokio::runtime::scheduler::multi_thread::worker::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:500:5\n 46: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/scheduler/multi_thread/worker.rs:466:45\n 47: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/task.rs:42:21\n 48: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:331:17\n 49: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/loom/std/unsafe_cell.rs:16:9\n 50: tokio::runtime::task::core::Core<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/core.rs:320:13\n 51: tokio::runtime::task::harness::poll_future::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:500:19\n 52: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 53: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 54: __rust_try\n 55: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 56: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 57: tokio::runtime::task::harness::poll_future\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:488:18\n 58: tokio::runtime::task::harness::Harness<T,S>::poll_inner\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:209:27\n 59: tokio::runtime::task::harness::Harness<T,S>::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/harness.rs:154:15\n 60: tokio::runtime::task::raw::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:271:5\n 61: tokio::runtime::task::raw::RawTask::poll\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/raw.rs:201:18\n 62: tokio::runtime::task::UnownedTask<S>::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/task/mod.rs:473:9\n 63: tokio::runtime::blocking::pool::Task::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:160:9\n 64: tokio::runtime::blocking::pool::Inner::run\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:518:17\n 65: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}}\n at /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.40.0/src/runtime/blocking/pool.rs:476:13\n 66: std::sys::backtrace::__rust_begin_short_backtrace\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/sys/backtrace.rs:154:18\n 67: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/mod.rs:561:17\n 68: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/panic/unwind_safe.rs:272:9\n 69: std::panicking::try::do_call\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:557:40\n 70: __rust_try\n 71: std::panicking::try\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panicking.rs:520:19\n 72: std::panic::catch_unwind\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/panic.rs:358:14\n 73: std::thread::Builder::spawn_unchecked_::{{closure}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/thread/mod.rs:559:30\n 74: core::ops::function::FnOnce::call_once{{vtable.shim}}\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/core/src/ops/function.rs:250:5\n 75: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/alloc/src/boxed.rs:1972:9\n 76: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/alloc/src/boxed.rs:1972:9\n 77: std::sys::pal::unix::thread::Thread::new::thread_start\n at /rustc/9fc6b43126469e3858e2fe86cafb4f0fd5068869/library/std/src/sys/pal/unix/thread.rs:105:17\n 78: _thrp_setup\n 79: <unknown>","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.225141878Z","target":"phd_runner::execute","line":129,"file":"phd-tests/runner/src/execute.rs"}
4242025-01-22T01:38:03.259Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.225197468Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs"}
4252025-01-22T01:38:03.259Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] trying to ensure Propolis server VM is destroyed","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.225244489Z","target":"phd_framework::test_vm","line":1019,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4262025-01-22T01:38:03.259Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.225727944Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9002","vm":"migration_from_base_lifecycle_0","vm_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4272025-01-22T01:38:03.329Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.361641215Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base_lifecycle_0","elapsed_milliseconds":137,"vm_id":"8fc456a4-ee81-447f-b3e6-5d909a448159","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4282025-01-22T01:38:03.352Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] Killing Propolis server process","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.362980249Z","target":"phd_framework::test_vm::server","line":125,"file":"phd-tests/framework/src/test_vm/server.rs","self.address":"127.0.0.1:9000","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4292025-01-22T01:38:03.462Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs clone dropped","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.494989121Z","target":"phd_framework::zfs","line":83,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4302025-01-22T01:38:03.485Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.495093931Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts/phd-clone-b217355b-6cad-4b58-a6f3-b9143cc91f0b\"]","verb":"destroy","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4312025-01-22T01:38:03.509Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] zfs snapshot dropped","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.533890906Z","target":"phd_framework::zfs","line":57,"file":"phd-tests/framework/src/zfs.rs","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4322025-01-22T01:38:03.509Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - EVENT] executing ZFS command","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.533947626Z","target":"phd_framework::zfs","line":304,"file":"phd-tests/framework/src/zfs.rs","args":"[\"phd-artifacts@phd-0b5da7eb-3c40-4a1a-890a-28786da481e3\"]","verb":"destroy","vm":"migration_from_base","vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4332025-01-22T01:38:03.534Z{"v":0,"name":"phd-runner","msg":"[VM CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.566926942Z","target":"phd_framework::test_vm","line":996,"file":"phd-tests/framework/src/test_vm/mod.rs","vm":"migration_from_base","elapsed_milliseconds":342,"vm_id":"6430b126-aabd-405f-8692-c78530fccd35","path":"phd_tests::migrate::from_base::can_migrate_from_base"}
4342025-01-22T01:38:03.534Z{"v":0,"name":"phd-runner","msg":"[TEST - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.566972162Z","target":"phd_tests::migrate::from_base","line":34,"file":"phd-tests/tests/src/migrate.rs","path":"phd_tests::migrate::from_base::can_migrate_from_base","elapsed_milliseconds":9513}
4352025-01-22T01:38:03.558Z{"v":0,"name":"phd-runner","msg":"[TEST_CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.567164614Z","target":"phd_runner::fixtures","line":51,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":341}
4362025-01-22T01:38:03.558Z{"v":0,"name":"phd-runner","msg":"[EXECUTION_CLEANUP - START]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.567228155Z","target":"phd_runner::fixtures","line":35,"file":"phd-tests/runner/src/fixtures.rs"}
4372025-01-22T01:38:03.558Z{"v":0,"name":"phd-runner","msg":"[EXECUTION_CLEANUP - END]","level":30,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.567258535Z","target":"phd_runner::fixtures","line":35,"file":"phd-tests/runner/src/fixtures.rs","elapsed_milliseconds":0}
4382025-01-22T01:38:03.558Z
4392025-01-22T01:38:03.558Zfailures:
4402025-01-22T01:38:03.558Z phd_tests::migrate::from_base::migration_from_base_and_back
4412025-01-22T01:38:03.558Z phd_tests::migrate::from_base::serial_history
4422025-01-22T01:38:03.558Z phd_tests::migrate::from_base::can_migrate_from_base
4432025-01-22T01:38:03.558Z
4442025-01-22T01:38:03.558Ztest result: FAILED. 0 passed; 3 failed; 0 skipped; 0 not run; finished in 97.03s
4452025-01-22T01:38:03.558Z
4462025-01-22T01:38:03.558Z{"v":0,"name":"phd-runner","msg":"phd_runner","level":20,"hostname":"buskin","pid":862,"time":"2025-01-22T01:38:03.567344366Z","target":"phd_runner","line":40,"file":"phd-tests/runner/src/main.rs","exit_code":3}
4472025-01-22T01:38:03.597Z
4482025-01-22T01:38:03.621Zreal 1:37.772064847
4492025-01-22T01:38:03.621Zuser 31.552590291
4502025-01-22T01:38:03.621Zsys 14.724792611
4512025-01-22T01:38:03.621Ztrap 0.003759125
4522025-01-22T01:38:03.621Ztflt 0.001110747
4532025-01-22T01:38:03.621Zdflt 0.000422898
4542025-01-22T01:38:03.621Zkflt 0.000658617
4552025-01-22T01:38:03.621Zlock 1:31:21.765634614
4562025-01-22T01:38:03.621Zslp 3:17.767594566
4572025-01-22T01:38:03.621Zlat 0.316431559
4582025-01-22T01:38:03.621Zstop 19.625354563
4592025-01-22T01:38:03.621Z+ failcount=3
4602025-01-22T01:38:03.621Z+ set -e
4612025-01-22T01:38:03.621Z+ tar -czvf /tmp/phd-tmp-files.tar.gz -C /tmp/propolis-phd /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stderr.log /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stdout.log /tmp/propolis-phd/migration_from_base_and_back.serial.log /tmp/propolis-phd/migration_from_base_and_back.stderr.log /tmp/propolis-phd/migration_from_base_and_back.stdout.log /tmp/propolis-phd/migration_from_base_lifecycle_0.stderr.log /tmp/propolis-phd/migration_from_base_lifecycle_0.stdout.log /tmp/propolis-phd/migration_from_base.serial.log /tmp/propolis-phd/migration_from_base.stderr.log /tmp/propolis-phd/migration_from_base.stdout.log /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stderr.log /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stdout.log /tmp/propolis-phd/migration_serial_history_base.serial.log /tmp/propolis-phd/migration_serial_history_base.stderr.log /tmp/propolis-phd/migration_serial_history_base.stdout.log
4622025-01-22T01:38:03.621ZCompressing '/tmp/phd-tmp-files.tar.gz' with '/usr/bin/gzip'...
4632025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stderr.log 0K
4642025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base_and_back_lifecycle_0.stdout.log 21K
4652025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base_and_back.serial.log 7K
4662025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base_and_back.stderr.log 0K
4672025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base_and_back.stdout.log 125K
4682025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base_lifecycle_0.stderr.log 0K
4692025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base_lifecycle_0.stdout.log 21K
4702025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base.serial.log 7K
4712025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base.stderr.log 0K
4722025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_from_base.stdout.log 124K
4732025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stderr.log 0K
4742025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_serial_history_base_lifecycle_0.stdout.log 21K
4752025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_serial_history_base.serial.log 7K
4762025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_serial_history_base.stderr.log 0K
4772025-01-22T01:38:03.621Za /tmp/propolis-phd/migration_serial_history_base.stdout.log 126K
4782025-01-22T01:38:03.621Z+ exitcode=0
4792025-01-22T01:38:03.621Z+ '[' 3 -eq 0 ']'
4802025-01-22T01:38:03.621Z+ echo
4812025-01-22T01:38:03.621Z
4822025-01-22T01:38:03.622Z+ echo 'SOME TESTS FAILED'
4832025-01-22T01:38:03.622ZSOME TESTS FAILED
4842025-01-22T01:38:03.622Z+ echo
4852025-01-22T01:38:03.622Z
4862025-01-22T01:38:03.622Z+ exitcode=1
4872025-01-22T01:38:03.622Z+ find /dev/vmm -mindepth 1 -maxdepth 1
4882025-01-22T01:38:03.622Z+ read
4892025-01-22T01:38:03.622Z+ exit 1
4902025-01-22T01:38:03.622Zprocess exited: duration 107130 ms, exit code 1
 
4912025-01-22T01:38:03.694Zfound 2 output files
4922025-01-22T01:38:03.694Zuploading: /tmp/phd-runner.log (170484 bytes)
4932025-01-22T01:38:04.912Zuploaded: /tmp/phd-runner.log
4942025-01-22T01:38:04.912Zuploading: /tmp/phd-tmp-files.tar.gz (39734 bytes)
4952025-01-22T01:38:06.065Zuploaded: /tmp/phd-tmp-files.tar.gz