01KQX2AN0MXJDB8E7E5R1Z8Z5D: build-and-test (helios)

BasicConfig {
    output_rules: [
        "%/work/*",
        "%/work/oxidecomputer/omicron/target/nextest/ci/junit.xml",
        "%/work/oxidecomputer/omicron/target/live-tests-archive.tgz",
        "=/tmp/nextest-run-archive.zip",
        "=/tmp/nextest-chrome-trace.json",
        "%/var/tmp/omicron_tmp/**/*",
        "!/var/tmp/omicron_tmp/crdb-base*",
        "!/var/tmp/omicron_tmp/rustc*",
    ],
    rust_toolchain: Some(
        Bool(
            true,
        ),
    ),
    target: Some(
        "helios-2.0-32c256gb",
    ),
    access_repos: [
        "oxidecomputer/dendrite",
    ],
    publish: [
        BasicConfigPublish {
            from_output: "/work/oxidecomputer/omicron/target/nextest/ci/junit.xml",
            series: "junit-helios",
            name: "junit.xml",
        },
        BasicConfigPublish {
            from_output: "/work/environment.json",
            series: "junit-helios",
            name: "environment.json",
        },
        BasicConfigPublish {
            from_output: "/work/cargo-build-analysis.jsonl",
            series: "build-info-helios",
            name: "cargo-build-analysis.jsonl",
        },
        BasicConfigPublish {
            from_output: "/work/oxidecomputer/omicron/target/live-tests-archive.tgz",
            series: "live-tests",
            name: "live-tests-archive.tgz",
        },
        BasicConfigPublish {
            from_output: "/tmp/nextest-run-archive.zip",
            series: "nextest-recording-helios",
            name: "nextest-run-archive.zip",
        },
        BasicConfigPublish {
            from_output: "/tmp/nextest-chrome-trace.json",
            series: "nextest-recording-helios",
            name: "nextest-chrome-trace.json",
        },
    ],
    skip_clone: false,
}

Buildomat Job: 01KQX2AZ92T1VRX4C541YX67CX

Tags:

Output:

SEQ GLOBAL TIME DETAILS
12026-05-05T21:58:27.536Zjob assigned to worker 01KQX2AZCPZ47M3EJ1RCXSB7XD [factory aws, i-0fdd0b1ea969b07af] (queued for 53 s)
 
22026-05-05T21:58:35.997Zstarting task 0: "setup"
32026-05-05T21:58:36.002Z++ uname -s
42026-05-05T21:58:36.005Z+ kern=SunOS
52026-05-05T21:58:36.005Z+ build_user=build
62026-05-05T21:58:36.005Z+ build_uid=12345
72026-05-05T21:58:36.005Z+ work_dir=/work
82026-05-05T21:58:36.005Z+ input_dir=/input
92026-05-05T21:58:36.005Z+ [[ 0 == 12345 ]]
102026-05-05T21:58:36.006Z+ case "$kern" in
112026-05-05T21:58:36.006Z+ groupadd -g 12345 build
122026-05-05T21:58:36.008Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
132026-05-05T21:58:38.016Z+ zfs create -o mountpoint=/work rpool/work
142026-05-05T21:58:38.143Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
152026-05-05T21:58:38.147Z+ home_fs=zfs
162026-05-05T21:58:38.147Z+ [[ zfs == autofs ]]
172026-05-05T21:58:38.147Z+ mkdir -p /home/build
182026-05-05T21:58:38.148Z+ chown build:build /home/build /work
192026-05-05T21:58:40.151Z+ chmod 0700 /home/build /work
202026-05-05T21:58:40.155Zprocess exited: duration 4163 ms, exit code 0
 
212026-05-05T21:58:40.162Zstarting task 1: "rust-toolchain"
222026-05-05T21:58:40.169Z+ printf ' * rust toolchain channel = "%s"\n' 1.94.0
232026-05-05T21:58:40.169Z+ printf ' * rust toolchain profile = "%s"\n' default
242026-05-05T21:58:40.169Z+ export RUSTUP_INIT_SKIP_PATH_CHECK=true
252026-05-05T21:58:40.169Z+ RUSTUP_INIT_SKIP_PATH_CHECK=true
262026-05-05T21:58:40.169Z * rust toolchain channel = "1.94.0"
272026-05-05T21:58:40.169Z * rust toolchain profile = "default"
282026-05-05T21:58:40.172Z+ curl --proto =https --tlsv1.2 -sSf https://sh.rustup.rs
292026-05-05T21:58:40.173Z+ /bin/bash -s - -y --no-modify-path --default-toolchain 1.94.0 --profile default
302026-05-05T21:58:40.305Zinfo: downloading installer
312026-05-05T21:58:41.826Zwarn: It looks like you have an existing installation of Rust at:
322026-05-05T21:58:41.826Zwarn: /opt/ooce/bin
332026-05-05T21:58:41.826Zwarn: It is recommended that rustup be the primary Rust installation.
342026-05-05T21:58:41.826Zwarn: Otherwise you may have confusion unless you are careful with your PATH.
352026-05-05T21:58:41.826Zwarn: If you are sure that you want both rustup and your already installed Rust
362026-05-05T21:58:41.826Zwarn: then please reply `y' or `yes' or set RUSTUP_INIT_SKIP_PATH_CHECK to yes
372026-05-05T21:58:41.826Zwarn: or pass `-y' to ignore all ignorable checks.
382026-05-05T21:58:41.826Zerror: cannot install while Rust is installed
392026-05-05T21:58:41.826Zwarn: continuing (because the -y flag is set and the error is ignorable)
402026-05-05T21:58:41.826Zwarn: It looks like you have an existing rustup settings file at:
412026-05-05T21:58:41.827Zwarn: /home/build/.rustup/settings.toml
422026-05-05T21:58:41.827Zwarn: Rustup will install the default toolchain as specified in the settings file,
432026-05-05T21:58:41.827Zwarn: instead of the one inferred from the default host triple.
442026-05-05T21:58:41.839Zinfo: profile set to default
452026-05-05T21:58:41.839Zinfo: default host triple is x86_64-unknown-illumos
462026-05-05T21:58:41.843Zinfo: syncing channel updates for 1.94.0-x86_64-unknown-illumos
472026-05-05T21:58:41.980Zinfo: latest update on 2026-03-05 for version 1.94.0 (4a4ef493e 2026-03-02)
482026-05-05T21:58:41.980Zinfo: downloading 6 components
492026-05-05T21:58:57.901Zinfo: default toolchain set to 1.94.0-x86_64-unknown-illumos
502026-05-05T21:58:57.901Z
512026-05-05T21:58:57.930Z 1.94.0-x86_64-unknown-illumos installed - rustc 1.94.0 (4a4ef493e 2026-03-02)
522026-05-05T21:58:57.930Z
532026-05-05T21:58:57.930Z
542026-05-05T21:58:57.930ZRust is installed now. Great!
552026-05-05T21:58:57.930Z
562026-05-05T21:58:57.930ZTo get started you need Cargo's bin directory ($HOME/.cargo/bin) in your PATH
572026-05-05T21:58:57.930Zenvironment variable. This has not been done automatically.
582026-05-05T21:58:57.930Z
592026-05-05T21:58:57.930ZTo configure your current shell, you need to source
602026-05-05T21:58:57.930Zthe corresponding env file under $HOME/.cargo.
612026-05-05T21:58:57.930Z
622026-05-05T21:58:57.931ZThis is usually done by running one of the following (note the leading DOT):
632026-05-05T21:58:57.931Z. "$HOME/.cargo/env" # For sh/bash/zsh/ash/dash/pdksh
642026-05-05T21:58:57.931Zsource "$HOME/.cargo/env.fish" # For fish
652026-05-05T21:58:57.931Zsource "~/.cargo/env.nu" # For nushell
662026-05-05T21:58:57.931Zsource "$HOME/.cargo/env.tcsh" # For tcsh
672026-05-05T21:58:57.931Z. "$HOME/.cargo/env.ps1" # For pwsh
682026-05-05T21:58:57.931Zsource "$HOME/.cargo/env.xsh" # For xonsh
692026-05-05T21:58:57.934Zwarn: no default linker (`cc`) was found in your PATH
702026-05-05T21:58:57.934Zwarn: many Rust crates require a system C toolchain to build
712026-05-05T21:58:58.033Z+ rustup --version
722026-05-05T21:58:58.039Zrustup 1.29.0 (28d1352db 2026-03-05)
732026-05-05T21:58:58.039Zinfo: This is the version for the rustup toolchain manager, not the rustc compiler.
742026-05-05T21:58:58.059Zinfo: the currently active `rustc` version is `rustc 1.94.0 (4a4ef493e 2026-03-02)`
752026-05-05T21:58:58.086Z+ cargo --version
762026-05-05T21:58:58.086Zcargo 1.94.0 (85eff7c80 2026-01-15)
772026-05-05T21:58:58.086Z+ rustc --version
782026-05-05T21:58:58.095Zrustc 1.94.0 (4a4ef493e 2026-03-02)
792026-05-05T21:58:58.098Zprocess exited: duration 17932 ms, exit code 0
 
802026-05-05T21:58:58.103Zstarting task 2: "authentication"
812026-05-05T21:58:58.127Zprocess exited: duration 23 ms, exit code 0
 
822026-05-05T21:58:58.133Zstarting task 3: "clone repository"
832026-05-05T21:58:58.139Z+ mkdir -p /work/oxidecomputer/omicron
842026-05-05T21:58:58.142Z+ git clone https://github.com/oxidecomputer/omicron /work/oxidecomputer/omicron
852026-05-05T21:58:58.180ZCloning into '/work/oxidecomputer/omicron'...
862026-05-05T21:59:07.518Z+ cd /work/oxidecomputer/omicron
872026-05-05T21:59:07.518Z+ git fetch origin 24502fa1e4a0fabc0909c954327853a8653613c1
882026-05-05T21:59:07.792ZFrom https://github.com/oxidecomputer/omicron
892026-05-05T21:59:07.792Z * branch 24502fa1e4a0fabc0909c954327853a8653613c1 -> FETCH_HEAD
902026-05-05T21:59:07.806Z+ [[ -n iliana/cockroach-go1.26 ]]
912026-05-05T21:59:07.810Z++ git branch --show-current
922026-05-05T21:59:07.813Z+ current=main
932026-05-05T21:59:07.813Z+ [[ main != iliana/cockroach-go1.26 ]]
942026-05-05T21:59:07.813Z+ git branch -f iliana/cockroach-go1.26 24502fa1e4a0fabc0909c954327853a8653613c1
952026-05-05T21:59:07.816Z+ git checkout -f iliana/cockroach-go1.26
962026-05-05T21:59:08.053ZSwitched to branch 'iliana/cockroach-go1.26'
972026-05-05T21:59:08.056Z+ git reset --hard 24502fa1e4a0fabc0909c954327853a8653613c1
982026-05-05T21:59:08.070ZHEAD is now at 24502fa1e update cockroachdb (go1.26)
992026-05-05T21:59:08.073Zprocess exited: duration 9936 ms, exit code 0
 
1002026-05-05T21:59:08.079Zstarting task 4: "build"
1012026-05-05T21:59:08.090Z+ source ./env.sh
1022026-05-05T21:59:08.090Z++ OLD_SHELL_OPTS=ehxB
1032026-05-05T21:59:08.090Z++ set -o xtrace
1042026-05-05T21:59:08.093Z++++ dirname ./env.sh
1052026-05-05T21:59:08.096Z+++ readlink -f .
1062026-05-05T21:59:08.099Z++ OMICRON_WS=/work/oxidecomputer/omicron
1072026-05-05T21:59:08.099Z++ export PATH=/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
1082026-05-05T21:59:08.099Z++ PATH=/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
1092026-05-05T21:59:08.099Z++ export PATH=/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
1102026-05-05T21:59:08.099Z++ PATH=/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
1112026-05-05T21:59:08.099Z++ export PATH=/work/oxidecomputer/omicron/out/dendrite-stub/bin:/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
1122026-05-05T21:59:08.100Z++ PATH=/work/oxidecomputer/omicron/out/dendrite-stub/bin:/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
1132026-05-05T21:59:08.100Z++ export PATH=/work/oxidecomputer/omicron/out/mgd/root/opt/oxide/mgd/bin:/work/oxidecomputer/omicron/out/dendrite-stub/bin:/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
1142026-05-05T21:59:08.100Z++ PATH=/work/oxidecomputer/omicron/out/mgd/root/opt/oxide/mgd/bin:/work/oxidecomputer/omicron/out/dendrite-stub/bin:/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
1152026-05-05T21:59:08.100Z++ case $OLD_SHELL_OPTS in
1162026-05-05T21:59:08.100Z++ unset OLD_SHELL_OPTS OMICRON_WS
1172026-05-05T21:59:08.100Z+ source .github/buildomat/ci-env.sh
1182026-05-05T21:59:08.100Z++ export CARGO_TERM_COLOR=always
1192026-05-05T21:59:08.100Z++ CARGO_TERM_COLOR=always
1202026-05-05T21:59:08.100Z+ target_os=illumos
1212026-05-05T21:59:08.100Z+ NEXTEST_VERSION=0.9.131
1222026-05-05T21:59:08.100Z+ cargo --version
1232026-05-05T21:59:08.109Zcargo 1.94.0 (85eff7c80 2026-01-15)
1242026-05-05T21:59:08.112Z+ rustc --version
1252026-05-05T21:59:08.134Zrustc 1.94.0 (4a4ef493e 2026-03-02)
1262026-05-05T21:59:08.138Z+ curl -sSfL --retry 10 https://get.nexte.st/0.9.131/illumos
1272026-05-05T21:59:08.141Z+ gunzip
1282026-05-05T21:59:08.141Z+ tar -xvf - -C /home/build/.cargo/bin
1292026-05-05T21:59:09.296Zx cargo-nextest, 22186872 bytes, 43334 tape blocks
1302026-05-05T21:59:09.299Z+ TEST_TMPDIR=/var/tmp/omicron_tmp
1312026-05-05T21:59:09.299Z+ echo 'tests will store ephemeral output in /var/tmp/omicron_tmp'
1322026-05-05T21:59:09.299Ztests will store ephemeral output in /var/tmp/omicron_tmp
1332026-05-05T21:59:09.299Z+ mkdir /var/tmp/omicron_tmp
1342026-05-05T21:59:09.302Z+ OUTPUT_DIR=/work
1352026-05-05T21:59:09.302Z+ echo 'tests will store non-ephemeral output in /work'
1362026-05-05T21:59:09.302Ztests will store non-ephemeral output in /work
1372026-05-05T21:59:09.302Z+ mkdir -p /work
1382026-05-05T21:59:09.305Z+ banner prerequisites
1392026-05-05T21:59:09.308Z
1402026-05-05T21:59:09.308Z ##### ##### ###### ##### ###### #### # # # #### #
1412026-05-05T21:59:09.308Z # # # # # # # # # # # # # # #
1422026-05-05T21:59:09.308Z # # # # ##### # # ##### # # # # # #### #
1432026-05-05T21:59:09.308Z ##### ##### # ##### # # # # # # # # #
1442026-05-05T21:59:09.308Z # # # # # # # # # # # # # # #
1452026-05-05T21:59:09.308Z # # # ###### # # ###### ### # #### # #### #
1462026-05-05T21:59:09.308Z
1472026-05-05T21:59:09.308Z+ ptime -m bash ./tools/install_builder_prerequisites.sh -y
1482026-05-05T21:59:19.551Z Startup: Refreshing catalog 'helios-dev' ... Done
1492026-05-05T21:59:27.020Z Startup: Caching catalogs ... Done
1502026-05-05T21:59:34.330ZPlanning: Solver setup ... Done (5.906s)
1512026-05-05T21:59:34.370ZPlanning: Running solver ... Done (0.042s)
1522026-05-05T21:59:34.511ZPlanning: Finding local manifests ... Done (0.004s)
1532026-05-05T21:59:34.534ZPlanning: Fetching manifests: 0/5 0% complete
1542026-05-05T21:59:34.664ZPlanning: Fetching manifests: 5/5 100% complete
1552026-05-05T21:59:34.700ZPlanning: Package planning ... Done (0.038s)
1562026-05-05T21:59:34.736ZPlanning: Merging actions ... Done (0.036s)
1572026-05-05T21:59:34.925ZPlanning: Checking for conflicting actions ... Done (0.189s)
1582026-05-05T21:59:34.936ZPlanning: Consolidating action changes ... Done (0.009s)
1592026-05-05T21:59:36.127ZPlanning: Evaluating mediators ... Done (1.192s)
1602026-05-05T21:59:36.135ZPlanning: Planning completed in 8.95 seconds
1612026-05-05T21:59:36.147Z Packages to install: 5
1622026-05-05T21:59:36.147Z Mediators to change: 3
1632026-05-05T21:59:36.147Z Services to change: 1
1642026-05-05T21:59:36.150Z Estimated space available: 155.33 GB
1652026-05-05T21:59:36.150ZEstimated space to be consumed: 1.90 GB
1662026-05-05T21:59:36.150Z Create boot environment: No
1672026-05-05T21:59:36.150ZCreate backup boot environment: No
1682026-05-05T21:59:36.150Z Rebuild boot archive: No
1692026-05-05T21:59:36.150Z
1702026-05-05T21:59:36.150ZChanged mediators:
1712026-05-05T21:59:36.150Z mediator clang:
1722026-05-05T21:59:36.150Z version: None -> 15 (system default)
1732026-05-05T21:59:36.150Z
1742026-05-05T21:59:36.150Z mediator llvm:
1752026-05-05T21:59:36.150Z version: 14 (system default) -> 15 (system default)
1762026-05-05T21:59:36.150Z
1772026-05-05T21:59:36.150Z mediator postgresql:
1782026-05-05T21:59:36.150Z version: 15 (system default) -> 18 (system default)
1792026-05-05T21:59:36.150Z
1802026-05-05T21:59:36.150ZChanged packages:
1812026-05-05T21:59:36.151Zhelios-dev
1822026-05-05T21:59:36.151Z developer/build-essential
1832026-05-05T21:59:36.151Z None -> 11-2.0
1842026-05-05T21:59:36.151Z library/libxmlsec1
1852026-05-05T21:59:36.151Z None -> 1.2.35-2.0
1862026-05-05T21:59:36.151Z ooce/developer/clang-15
1872026-05-05T21:59:36.151Z None -> 15.0.7-2.0
1882026-05-05T21:59:36.151Z ooce/developer/llvm-15
1892026-05-05T21:59:36.151Z None -> 15.0.7-2.0
1902026-05-05T21:59:36.152Z ooce/library/postgresql-18
1912026-05-05T21:59:36.152Z None -> 18.1-2.0
1922026-05-05T21:59:36.152Z
1932026-05-05T21:59:36.152ZServices:
1942026-05-05T21:59:36.152Z restart_fmri:
1952026-05-05T21:59:36.152Z svc:/system/update-man-index:default
1962026-05-05T21:59:36.198Z
1972026-05-05T21:59:36.198ZDownload: 0/4272 items 0.0/219.0MB 0% complete
1982026-05-05T21:59:42.348ZDownload: 2224/4272 items 119.2/219.0MB 54% complete (25.8M/s)
1992026-05-05T21:59:48.655ZDownload: 3246/4272 items 203.1/219.0MB 92% complete (20.3M/s)
2002026-05-05T21:59:55.241ZDownload: 3248/4272 items 203.1/219.0MB 92% complete (19.7M/s)
2012026-05-05T21:59:55.399Z
2022026-05-05T21:59:55.399ZErrors were encountered while attempting to retrieve package or file data for
2032026-05-05T21:59:55.399Zthe requested operation.
2042026-05-05T21:59:55.399ZDetails follow:
2052026-05-05T21:59:55.399Z
2062026-05-05T21:59:55.399Zpkg://helios-dev/ooce/developer/llvm-15@15.0.7,5.11-2.0:20230713T102340Z
2072026-05-05T21:59:55.399Z https protocol error: Unknown error code: 502 reason: Bad Gateway
2082026-05-05T21:59:55.399ZURL: 'https://pkg.oxide.computer/helios/2/dev/helios-dev/file/1/879b3c2c02894da647a77f02e4f6ea62e3b42577' (happened 4 times)
2092026-05-05T21:59:55.399Z
2102026-05-05T21:59:56.761Z
2112026-05-05T21:59:56.761Zreal 47.441605428
2122026-05-05T21:59:56.761Zuser 26.049236999
2132026-05-05T21:59:56.761Zsys 2.306503222
2142026-05-05T21:59:56.761Ztrap 0.003042314
2152026-05-05T21:59:56.761Ztflt 0.031064027
2162026-05-05T21:59:56.761Zdflt 0.046332537
2172026-05-05T21:59:56.762Zkflt 0.015101022
2182026-05-05T21:59:56.762Zlock 0.000000000
2192026-05-05T21:59:56.765Zslp 1:10.228499999
2202026-05-05T21:59:56.765Zlat 0.085804433
2212026-05-05T21:59:56.765Zstop 0.000450951
2222026-05-05T21:59:56.766Zprocess exited: duration 48674 ms, exit code 1
 
2232026-05-05T21:59:56.773Zfound 0 output files
2242026-05-05T21:59:56.773Zupload error: rule "/tmp/nextest-run-archive.zip" required a match, but was not used
2252026-05-05T21:59:56.773Zupload error: rule "/tmp/nextest-chrome-trace.json" required a match, but was not used