|
|
|
| 1 | 2025-09-12T23:20:17.763Z | job dependencies complete; ready to run (waiting for 8 m 58 s) |
| 2 | 2025-09-12T23:35:42.958Z | job assigned to worker 01K504A7QZ6KT7AXNRKHRBNGZQ [factory lab, buskin/16724] (queued for 15 m 25 s) |
| 3 | 2025-09-12T23:35:43.263Z | http://172.20.0.5:9969/ipxe/buskin... ok |
| 4 | 2025-09-12T23:35:43.306Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok |
| 5 | 2025-09-12T23:35:43.340Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok |
| 6 | 2025-09-12T23:35:43.373Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok |
| 7 | 2025-09-12T23:35:43.406Z | http://172.20.0.5:9969/postboot/buskin... ok |
| 8 | 2025-09-12T23:35:43.441Z | wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U |
| 9 | 2025-09-12T23:35:43.475Z | cpu0: microcode has been updated from version 0xa001133 to 0xa0011d5 |
| 10 | 2025-09-12T23:35:43.508Z | Oxide Helios Version helios-2.0.23457 64-bit |
| 11 | 2025-09-12T23:35:43.541Z | Configuring devices. |
| 12 | 2025-09-12T23:35:43.575Z | ################################################## |
| 13 | 2025-09-12T23:35:43.608Z | #### ############# ## |
| 14 | 2025-09-12T23:35:43.642Z | ### ### ############ ## |
| 15 | 2025-09-12T23:35:43.675Z | ## ### # ## ### ## Oxide Computer Company ## |
| 16 | 2025-09-12T23:35:43.709Z | ## ## ## ### # ### ## |
| 17 | 2025-09-12T23:35:43.742Z | ## # ### #### #### This Station Under ## |
| 18 | 2025-09-12T23:35:43.776Z | ### ### #### # ### Computer Control ## |
| 19 | 2025-09-12T23:35:43.809Z | #### #### ### ## ## |
| 20 | 2025-09-12T23:35:43.865Z | ################################################## |
| 21 | 2025-09-12T23:35:43.898Z | Hostname: buskin |
| 22 | 2025-09-12T23:35:43.932Z | Loading smf(7) service descriptions: |
| 23 | 2025-09-12T23:35:44.489Z | downloading input: /input/phd-build/out/phd-run-with-args.sh |
| 24 | 2025-09-12T23:35:44.522Z | downloaded input: /input/phd-build/out/phd-run-with-args.sh |
| 25 | 2025-09-12T23:35:44.522Z | downloading input: /input/phd-build/out/phd-runner.sha256.txt |
| 26 | 2025-09-12T23:35:44.560Z | downloaded input: /input/phd-build/out/phd-runner.sha256.txt |
| 27 | 2025-09-12T23:35:44.583Z | downloading input: /input/phd-build/out/phd-runner.tar.gz |
| 28 | 2025-09-12T23:36:03.741Z | downloaded input: /input/phd-build/out/phd-runner.tar.gz |
| 29 | 2025-09-12T23:36:03.765Z | downloading input: /input/phd-build/out/propolis-server-debug.sha256.txt |
| 30 | 2025-09-12T23:36:03.788Z | downloaded input: /input/phd-build/out/propolis-server-debug.sha256.txt |
| 31 | 2025-09-12T23:36:03.788Z | downloading input: /input/phd-build/out/propolis-server-debug.tar.gz |
| 32 | 2025-09-12T23:36:31.239Z | downloaded input: /input/phd-build/out/propolis-server-debug.tar.gz |
| |
| 33 | 2025-09-12T23:36:31.264Z | starting task 0: "setup" |
| 34 | 2025-09-12T23:36:31.264Z | ++ uname -s |
| 35 | 2025-09-12T23:36:31.264Z | + kern=SunOS |
| 36 | 2025-09-12T23:36:31.264Z | + build_user=build |
| 37 | 2025-09-12T23:36:31.264Z | + build_uid=12345 |
| 38 | 2025-09-12T23:36:31.264Z | + work_dir=/work |
| 39 | 2025-09-12T23:36:31.264Z | + input_dir=/input |
| 40 | 2025-09-12T23:36:31.264Z | + [[ 0 == 12345 ]] |
| 41 | 2025-09-12T23:36:31.264Z | + case "$kern" in |
| 42 | 2025-09-12T23:36:31.264Z | + groupadd -g 12345 build |
| 43 | 2025-09-12T23:36:31.264Z | + useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build |
| 44 | 2025-09-12T23:36:33.257Z | + zfs create -o mountpoint=/work rpool/work |
| 45 | 2025-09-12T23:36:33.282Z | ++ awk '$2 == "/home" { print $3 }' /etc/mnttab |
| 46 | 2025-09-12T23:36:33.282Z | + home_fs=zfs |
| 47 | 2025-09-12T23:36:33.282Z | + [[ zfs == autofs ]] |
| 48 | 2025-09-12T23:36:33.282Z | + mkdir -p /home/build |
| 49 | 2025-09-12T23:36:33.282Z | + chown build:build /home/build /work |
| 50 | 2025-09-12T23:36:34.281Z | + chmod 0700 /home/build /work |
| 51 | 2025-09-12T23:36:34.306Z | process exited: duration 3045 ms, exit code 0 |
| |
| 52 | 2025-09-12T23:36:34.355Z | starting task 1: "authentication" |
| 53 | 2025-09-12T23:36:34.399Z | process exited: duration 43 ms, exit code 0 |
| |
| 54 | 2025-09-12T23:36:34.446Z | starting task 2: "build" |
| 55 | 2025-09-12T23:36:34.475Z | + indir=/input |
| 56 | 2025-09-12T23:36:34.475Z | + indir_suffix='phd-build/out/*.tar.gz' |
| 57 | 2025-09-12T23:36:34.475Z | + phddir=/work/phd-test |
| 58 | 2025-09-12T23:36:34.475Z | + pfexec zpool create -f phd-artifacts c1t1d0 c2t1d0 |
| 59 | 2025-09-12T23:36:34.640Z | + artifactdir=/phd-artifacts |
| 60 | 2025-09-12T23:36:34.640Z | + banner Inputs |
| 61 | 2025-09-12T23:36:34.665Z | ### |
| 62 | 2025-09-12T23:36:34.665Z | # # # ##### # # ##### #### |
| 63 | 2025-09-12T23:36:34.665Z | # ## # # # # # # # |
| 64 | 2025-09-12T23:36:34.665Z | # # # # # # # # # #### |
| 65 | 2025-09-12T23:36:34.665Z | # # # # ##### # # # # |
| 66 | 2025-09-12T23:36:34.665Z | # # ## # # # # # # |
| 67 | 2025-09-12T23:36:34.665Z | ### # # # #### # #### |
| 68 | 2025-09-12T23:36:34.665Z | |
| 69 | 2025-09-12T23:36:34.665Z | + find /input -ls |
| 70 | 2025-09-12T23:36:34.665Z | 34 1 drwxr-xr-x 3 root root 3 Sep 12 23:35 /input |
| 71 | 2025-09-12T23:36:34.665Z | 2 1 drwxr-xr-x 3 root root 3 Sep 12 23:35 /input/phd-build |
| 72 | 2025-09-12T23:36:34.665Z | 3 2 drwxr-xr-x 2 root root 7 Sep 12 23:36 /input/phd-build/out |
| 73 | 2025-09-12T23:36:34.665Z | 128 3 -rw-r--r-- 1 root root 2402 Sep 12 23:35 /input/phd-build/out/phd-run-with-args.sh |
| 74 | 2025-09-12T23:36:34.665Z | 257 147684 -rw-r--r-- 1 root root 151128722 Sep 12 23:36 /input/phd-build/out/propolis-server-debug.tar.gz |
| 75 | 2025-09-12T23:36:34.665Z | 130 105839 -rw-r--r-- 1 root root 108309248 Sep 12 23:36 /input/phd-build/out/phd-runner.tar.gz |
| 76 | 2025-09-12T23:36:34.665Z | 129 1 -rw-r--r-- 1 root root 65 Sep 12 23:35 /input/phd-build/out/phd-runner.sha256.txt |
| 77 | 2025-09-12T23:36:34.665Z | 256 1 -rw-r--r-- 1 root root 65 Sep 12 23:36 /input/phd-build/out/propolis-server-debug.sha256.txt |
| 78 | 2025-09-12T23:36:34.665Z | + rm -rf /work/phd-test |
| 79 | 2025-09-12T23:36:34.666Z | + mkdir /work/phd-test |
| 80 | 2025-09-12T23:36:34.666Z | + for p in $indir/$indir_suffix |
| 81 | 2025-09-12T23:36:34.666Z | + tar xzvf /input/phd-build/out/phd-runner.tar.gz -C /work/phd-test |
| 82 | 2025-09-12T23:36:37.304Z | Decompressing '/input/phd-build/out/phd-runner.tar.gz' with '/usr/bin/gzcat'... |
| 83 | 2025-09-12T23:36:37.305Z | x phd-runner, 390376568 bytes, 762455 tape blocks |
| 84 | 2025-09-12T23:36:37.305Z | x artifacts.toml, 548 bytes, 2 tape blocks |
| 85 | 2025-09-12T23:36:37.329Z | ++ tar tf /input/phd-build/out/phd-runner.tar.gz |
| 86 | 2025-09-12T23:36:39.521Z | + for f in $(tar tf "$p") |
| 87 | 2025-09-12T23:36:39.521Z | + chmod +x /work/phd-test/phd-runner |
| 88 | 2025-09-12T23:36:39.546Z | + for f in $(tar tf "$p") |
| 89 | 2025-09-12T23:36:39.546Z | + chmod +x /work/phd-test/artifacts.toml |
| 90 | 2025-09-12T23:36:39.546Z | + for p in $indir/$indir_suffix |
| 91 | 2025-09-12T23:36:39.546Z | + tar xzvf /input/phd-build/out/propolis-server-debug.tar.gz -C /work/phd-test |
| 92 | 2025-09-12T23:36:43.118Z | Decompressing '/input/phd-build/out/propolis-server-debug.tar.gz' with '/usr/bin/gzcat'... |
| 93 | 2025-09-12T23:36:43.118Z | x propolis-server, 577129960 bytes, 1127207 tape blocks |
| 94 | 2025-09-12T23:36:43.143Z | ++ tar tf /input/phd-build/out/propolis-server-debug.tar.gz |
| 95 | 2025-09-12T23:36:46.309Z | + for f in $(tar tf "$p") |
| 96 | 2025-09-12T23:36:46.309Z | + chmod +x /work/phd-test/propolis-server |
| 97 | 2025-09-12T23:36:46.340Z | + ls /work/phd-test |
| 98 | 2025-09-12T23:36:46.341Z | artifacts.toml |
| 99 | 2025-09-12T23:36:46.341Z | phd-runner |
| 100 | 2025-09-12T23:36:46.341Z | propolis-server |
| 101 | 2025-09-12T23:36:46.341Z | + banner Setup |
| 102 | 2025-09-12T23:36:46.341Z | ##### |
| 103 | 2025-09-12T23:36:46.341Z | # # ###### ##### # # ##### |
| 104 | 2025-09-12T23:36:46.341Z | # # # # # # # |
| 105 | 2025-09-12T23:36:46.341Z | ##### ##### # # # # # |
| 106 | 2025-09-12T23:36:46.341Z | # # # # # ##### |
| 107 | 2025-09-12T23:36:46.341Z | # # # # # # # |
| 108 | 2025-09-12T23:36:46.341Z | ##### ###### # #### # |
| 109 | 2025-09-12T23:36:46.341Z | |
| 110 | 2025-09-12T23:36:46.341Z | + tmpdir=/tmp/propolis-phd |
| 111 | 2025-09-12T23:36:46.341Z | + '[' '!' -d /tmp/propolis-phd ']' |
| 112 | 2025-09-12T23:36:46.341Z | + mkdir /tmp/propolis-phd |
| 113 | 2025-09-12T23:36:46.341Z | + pfexec /usr/lib/rsrvrctl -s 4096 |
| 114 | 2025-09-12T23:36:46.922Z | + banner Tests |
| 115 | 2025-09-12T23:36:46.949Z | ####### |
| 116 | 2025-09-12T23:36:46.949Z | # ###### #### ##### #### |
| 117 | 2025-09-12T23:36:46.949Z | # # # # # |
| 118 | 2025-09-12T23:36:46.949Z | # ##### #### # #### |
| 119 | 2025-09-12T23:36:46.949Z | # # # # # |
| 120 | 2025-09-12T23:36:46.949Z | # # # # # # # |
| 121 | 2025-09-12T23:36:46.949Z | # ###### #### # #### |
| 122 | 2025-09-12T23:36:46.949Z | |
| 123 | 2025-09-12T23:36:46.949Z | + runner=/work/phd-test/phd-runner |
| 124 | 2025-09-12T23:36:46.949Z | + artifacts=/work/phd-test/artifacts.toml |
| 125 | 2025-09-12T23:36:46.949Z | + propolis=/work/phd-test/propolis-server |
| 126 | 2025-09-12T23:36:46.949Z | + ls /work/phd-test/phd-runner |
| 127 | 2025-09-12T23:36:46.949Z | /work/phd-test/phd-runner |
| 128 | 2025-09-12T23:36:46.949Z | + ls /work/phd-test/artifacts.toml |
| 129 | 2025-09-12T23:36:46.949Z | /work/phd-test/artifacts.toml |
| 130 | 2025-09-12T23:36:46.949Z | + ls /work/phd-test/propolis-server |
| 131 | 2025-09-12T23:36:46.949Z | /work/phd-test/propolis-server |
| 132 | 2025-09-12T23:36:46.949Z | + args=($runner '--emit-bunyan' 'run' '--propolis-server-cmd' $propolis '--crucible-downstairs-commit' 'auto' '--artifact-toml-path' $artifacts '--tmp-directory' $tmpdir '--artifact-directory' $artifactdir $@) |
| 133 | 2025-09-12T23:36:46.949Z | + set +e |
| 134 | 2025-09-12T23:36:46.950Z | + RUST_BACKTRACE=1 |
| 135 | 2025-09-12T23:36:46.950Z | + RUST_LOG=info,phd=debug |
| 136 | 2025-09-12T23:36:46.950Z | + ptime -m pfexec /work/phd-test/phd-runner --emit-bunyan run --propolis-server-cmd /work/phd-test/propolis-server --crucible-downstairs-commit auto --artifact-toml-path /work/phd-test/artifacts.toml --tmp-directory /tmp/propolis-phd --artifact-directory /phd-artifacts --exclude-filter phd_tests::migrate::from_base |
| 137 | 2025-09-12T23:36:46.950Z | + tee /tmp/phd-runner.log |
| 138 | 2025-09-12T23:36:46.975Z | {"v":0,"name":"phd-runner","msg":"phd_runner","level":30,"hostname":"buskin","pid":863,"time":"2025-09-12T23:36:46.713868634Z","target":"phd_runner","line":36,"file":"phd-tests/runner/src/main.rs","runner_args":"ProcessArgs { command: Run(RunOptions { propolis_server_cmd: \"/work/phd-test/propolis-server\", base_propolis_branch: None, base_propolis_commit: None, base_propolis_cmd: None, crucible_downstairs_cmd: None, crucible_downstairs_commit: Some(Auto), tmp_directory: \"/tmp/propolis-phd\", artifact_directory: Some(\"/phd-artifacts\"), output_mode: TmpFile, default_guest_cpus: 2, default_guest_memory_mib: 512, artifact_toml_path: \"/work/phd-test/artifacts.toml\", default_guest_artifact: \"alpine\", default_bootrom_artifact: \"ovmf\", include_filter: [], exclude_filter: [\"phd_tests::migrate::from_base\"], max_buildomat_wait_secs: 1200 }), disable_ansi: false, emit_bunyan: true }"} |
| 139 | 2025-09-12T23:36:47.001Z | {"v":0,"name":"phd-runner","msg":"Created new artifact store from manifest","level":20,"hostname":"buskin","pid":863,"time":"2025-09-12T23:36:46.716944966Z","target":"phd_framework::artifacts::store","line":221,"file":"phd-tests/framework/src/artifacts/store.rs","store":"Store { local_dir: \"/phd-artifacts\", artifacts: {\"alpine\": Mutex { data: StoredArtifact { description: Artifact { filename: \"alpine.iso\", kind: GuestOs(Alpine), source: RemoteServer { sha256: \"ba8007f74f9b54fbae3b2520da577831b4834778a498d732f091260c61aa7ca1\" }, untar: None }, cached_path: None } }, \"ovmf\": Mutex { data: StoredArtifact { description: Artifact { filename: \"OVMF_CODE.fd\", kind: Bootrom, source: Buildomat(BuildomatArtifact { repo: Repo(\"oxidecomputer/edk2\"), series: Series(\"image_debug\"), commit: Commit(\"907a5fd1763ce5ddd74001261e5b52cd200a25f9\"), sha256: \"ff12d5cb021e34447b44301f70434e861b07d2779c16abe2f2efef49ff02fffb\" }), untar: None }, cached_path: None } }}, downloader: DownloadConfig { timeout: 600s, buildomat_backoff: ExponentialBackoff { current_interval: 1s, initial_interval: 1s, randomization_factor: 0.5, multiplier: 1.5, max_interval: 60s, start_time: Instant { tv_sec: 411, tv_nsec: 732644412 }, max_elapsed_time: Some(1200s), clock: SystemClock }, remote_server_uris: [\"https://oxide-omicron-build.s3.amazonaws.com\"] } }"} |
| 140 | 2025-09-12T23:36:47.001Z | {"v":0,"name":"phd-runner","msg":"Adding Propolis server from local command","level":30,"hostname":"buskin","pid":863,"time":"2025-09-12T23:36:46.716996037Z","target":"phd_framework::artifacts::store","line":229,"file":"phd-tests/framework/src/artifacts/store.rs","propolis_server_cmd":"/work/phd-test/propolis-server"} |
| 141 | 2025-09-12T23:36:47.001Z | {"v":0,"name":"phd-runner","msg":"Adding crucible-downstairs from Buildomat Git revision","level":30,"hostname":"buskin","pid":863,"time":"2025-09-12T23:36:46.717054818Z","target":"phd_framework::artifacts::store","line":313,"file":"phd-tests/framework/src/artifacts/store.rs","commit":"e164393a88e7b62598897dc4f53315f083e25333"} |
| 142 | 2025-09-12T23:36:47.001Z | {"v":0,"name":"phd-runner","msg":"Downloading file from Buildomat...","level":20,"hostname":"buskin","pid":863,"time":"2025-09-12T23:36:46.717307772Z","target":"phd_framework::artifacts::buildomat","line":215,"file":"phd-tests/framework/src/artifacts/buildomat.rs","uri":"https://buildomat.eng.oxide.computer/public/file/oxidecomputer/crucible/nightly-image/e164393a88e7b62598897dc4f53315f083e25333/crucible-nightly.sha256.txt","timeout":"600s"} |
| 143 | 2025-09-12T23:36:47.229Z | {"v":0,"name":"phd-runner","msg":"No 'migration base' Propolis server provided. Migration-from-base tests will be skipped.","level":40,"hostname":"buskin","pid":863,"time":"2025-09-12T23:36:46.968812421Z","target":"phd_framework","line":179,"file":"phd-tests/framework/src/lib.rs"} |
| 144 | 2025-09-12T23:36:47.229Z | {"v":0,"name":"phd-runner","msg":"No tests selected for execution","level":30,"hostname":"buskin","pid":863,"time":"2025-09-12T23:36:46.968915323Z","target":"phd_runner::execute","line":76,"file":"phd-tests/runner/src/execute.rs"} |
| 145 | 2025-09-12T23:36:47.229Z | test result: ok. 0 passed; 0 failed; 0 skipped; 0 not run; finished in 0.00s |
| 146 | 2025-09-12T23:36:47.229Z | |
| 147 | 2025-09-12T23:36:47.254Z | {"v":0,"name":"phd-runner","msg":"phd_runner","level":20,"hostname":"buskin","pid":863,"time":"2025-09-12T23:36:46.968960803Z","target":"phd_runner","line":41,"file":"phd-tests/runner/src/main.rs","exit_code":0} |
| 148 | 2025-09-12T23:36:47.254Z | |
| 149 | 2025-09-12T23:36:47.254Z | real 0.293024791 |
| 150 | 2025-09-12T23:36:47.254Z | user 0.055684864 |
| 151 | 2025-09-12T23:36:47.254Z | sys 0.050131682 |
| 152 | 2025-09-12T23:36:47.254Z | trap 0.000181421 |
| 153 | 2025-09-12T23:36:47.254Z | tflt 0.000093801 |
| 154 | 2025-09-12T23:36:47.254Z | dflt 0.000100696 |
| 155 | 2025-09-12T23:36:47.254Z | kflt 0.000003449 |
| 156 | 2025-09-12T23:36:47.254Z | lock 13.311849565 |
| 157 | 2025-09-12T23:36:47.254Z | slp 0.340811340 |
| 158 | 2025-09-12T23:36:47.254Z | lat 0.009696277 |
| 159 | 2025-09-12T23:36:47.254Z | stop 0.000205357 |
| 160 | 2025-09-12T23:36:47.255Z | + failcount=0 |
| 161 | 2025-09-12T23:36:47.255Z | + set -e |
| 162 | 2025-09-12T23:36:47.255Z | + tar -czvf /tmp/phd-tmp-files.tar.gz -C /tmp/propolis-phd '/tmp/propolis-phd/*.log' |
| 163 | 2025-09-12T23:36:47.255Z | tar: /tmp/propolis-phd/*.log: No such file or directory |
| 164 | 2025-09-12T23:36:47.255Z | Compressing '/tmp/phd-tmp-files.tar.gz' with '/usr/bin/gzip'... |
| 165 | 2025-09-12T23:36:47.255Z | process exited: duration 12795 ms, exit code 1 |
| |
| 166 | 2025-09-12T23:36:47.305Z | found 2 output files |
| 167 | 2025-09-12T23:36:47.306Z | uploading: /tmp/phd-runner.log (4152 bytes) |
| 168 | 2025-09-12T23:36:48.406Z | uploaded: /tmp/phd-runner.log |
| 169 | 2025-09-12T23:36:48.406Z | uploading: /tmp/phd-tmp-files.tar.gz (29 bytes) |
| 170 | 2025-09-12T23:36:49.508Z | uploaded: /tmp/phd-tmp-files.tar.gz |