01GFWB3PDF39QQ2GKKQXSBGXX7: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/system-illumos-sled-agent:default.log",
        "%/zone/oxz_nexus/root/var/svc/log/system-illumos-nexus:default.log",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-netdev",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01GFWB479FFF499JA7B4075AJJ

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12022-10-21T04:22:33.081Zjob dependencies complete; ready to run (waiting for 23 m 7 s)
22022-10-21T04:23:38.179Zjob assigned to worker 01GFWCEQWQFAXZZ7MJWT70XVMC (queued for 1 m 5 s)
32022-10-21T04:23:38.213Zhttp://172.20.0.2:9969/ipxe/buskin... ok
42022-10-21T04:23:38.262Zhttp://172.20.0.2:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52022-10-21T04:23:38.307Zhttp://172.20.0.2:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62022-10-21T04:23:38.351Zhttp://172.20.0.2:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72022-10-21T04:23:38.389Zhttp://172.20.0.2:9969/postboot/buskin... ok
82022-10-21T04:23:38.429ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92022-10-21T04:23:38.474ZWARNING: cpu0: failed to update microcode from version 0xa001133 to 0x0
102022-10-21T04:23:38.518ZOxide Helios Version xde-0-g03536bce00 64-bit (onu)
112022-10-21T04:23:38.556ZERROR: failed to attach AMD IOMMU
122022-10-21T04:23:38.623ZWARNING: cpu1: failed to update microcode from version 0xa001133 to 0x0
132022-10-21T04:23:38.663ZWARNING: cpu2: failed to update microcode from version 0xa001133 to 0x0
142022-10-21T04:23:38.701ZWARNING: cpu3: failed to update microcode from version 0xa001133 to 0x0
152022-10-21T04:23:38.741ZWARNING: cpu4: failed to update microcode from version 0xa001133 to 0x0
162022-10-21T04:23:38.779ZWARNING: cpu5: failed to update microcode from version 0xa001133 to 0x0
172022-10-21T04:23:38.819ZWARNING: cpu6: failed to update microcode from version 0xa001133 to 0x0
182022-10-21T04:23:38.856ZWARNING: cpu7: failed to update microcode from version 0xa001133 to 0x0
192022-10-21T04:23:38.897ZWARNING: cpu8: failed to update microcode from version 0xa001133 to 0x0
202022-10-21T04:23:38.935ZWARNING: cpu9: failed to update microcode from version 0xa001133 to 0x0
212022-10-21T04:23:38.975ZWARNING: cpu10: failed to update microcode from version 0xa001133 to 0x0
222022-10-21T04:23:39.014ZWARNING: cpu11: failed to update microcode from version 0xa001133 to 0x0
232022-10-21T04:23:39.053ZWARNING: cpu12: failed to update microcode from version 0xa001133 to 0x0
242022-10-21T04:23:39.091ZWARNING: cpu13: failed to update microcode from version 0xa001133 to 0x0
252022-10-21T04:23:39.131ZWARNING: cpu14: failed to update microcode from version 0xa001133 to 0x0
262022-10-21T04:23:39.169ZWARNING: cpu15: failed to update microcode from version 0xa001133 to 0x0
272022-10-21T04:23:39.303ZWARNING: cpu16: failed to update microcode from version 0xa001133 to 0x0
282022-10-21T04:23:39.343ZWARNING: cpu17: failed to update microcode from version 0xa001133 to 0x0
292022-10-21T04:23:39.381ZWARNING: cpu18: failed to update microcode from version 0xa001133 to 0x0
302022-10-21T04:23:39.420ZWARNING: cpu19: failed to update microcode from version 0xa001133 to 0x0
312022-10-21T04:23:39.459ZWARNING: cpu20: failed to update microcode from version 0xa001133 to 0x0
322022-10-21T04:23:39.503ZWARNING: cpu21: failed to update microcode from version 0xa001133 to 0x0
332022-10-21T04:23:39.548ZWARNING: cpu22: failed to update microcode from version 0xa001133 to 0x0
342022-10-21T04:23:39.587ZWARNING: cpu23: failed to update microcode from version 0xa001133 to 0x0
352022-10-21T04:23:39.626ZWARNING: cpu24: failed to update microcode from version 0xa001133 to 0x0
362022-10-21T04:23:39.665ZWARNING: cpu25: failed to update microcode from version 0xa001133 to 0x0
372022-10-21T04:23:39.704ZWARNING: cpu26: failed to update microcode from version 0xa001133 to 0x0
382022-10-21T04:23:39.743ZWARNING: cpu27: failed to update microcode from version 0xa001133 to 0x0
392022-10-21T04:23:39.782ZWARNING: cpu28: failed to update microcode from version 0xa001133 to 0x0
402022-10-21T04:23:39.821ZWARNING: cpu29: failed to update microcode from version 0xa001133 to 0x0
412022-10-21T04:23:39.859ZWARNING: cpu30: failed to update microcode from version 0xa001133 to 0x0
422022-10-21T04:23:39.899ZWARNING: cpu31: failed to update microcode from version 0xa001133 to 0x0
432022-10-21T04:23:39.943ZWARNING: cpu32: failed to update microcode from version 0xa001133 to 0x0
442022-10-21T04:23:39.982ZWARNING: cpu33: failed to update microcode from version 0xa001133 to 0x0
452022-10-21T04:23:40.022ZWARNING: cpu34: failed to update microcode from version 0xa001133 to 0x0
462022-10-21T04:23:40.060ZWARNING: cpu35: failed to update microcode from version 0xa001133 to 0x0
472022-10-21T04:23:40.099ZWARNING: cpu36: failed to update microcode from version 0xa001133 to 0x0
482022-10-21T04:23:40.138ZWARNING: cpu37: failed to update microcode from version 0xa001133 to 0x0
492022-10-21T04:23:40.177ZWARNING: cpu38: failed to update microcode from version 0xa001133 to 0x0
502022-10-21T04:23:40.216ZWARNING: cpu39: failed to update microcode from version 0xa001133 to 0x0
512022-10-21T04:23:40.255ZWARNING: cpu40: failed to update microcode from version 0xa001133 to 0x0
522022-10-21T04:23:40.293ZWARNING: cpu41: failed to update microcode from version 0xa001133 to 0x0
532022-10-21T04:23:40.422ZWARNING: cpu42: failed to update microcode from version 0xa001133 to 0x0
542022-10-21T04:23:40.460ZWARNING: cpu43: failed to update microcode from version 0xa001133 to 0x0
552022-10-21T04:23:40.499ZWARNING: cpu44: failed to update microcode from version 0xa001133 to 0x0
562022-10-21T04:23:40.538ZWARNING: cpu45: failed to update microcode from version 0xa001133 to 0x0
572022-10-21T04:23:40.578ZWARNING: cpu46: failed to update microcode from version 0xa001133 to 0x0
582022-10-21T04:23:40.616ZWARNING: cpu47: failed to update microcode from version 0xa001133 to 0x0
592022-10-21T04:23:40.655ZConfiguring devices.
602022-10-21T04:23:40.694ZNOTICE: tfpkt0: tfkt_attach
612022-10-21T04:23:40.733ZNOTICE: tfpkt0: creating tfpkt 0
622022-10-21T04:23:40.779ZNOTICE: tfpkt0: tf_tbus_init
632022-10-21T04:23:40.817ZNOTICE: tofino_tbus_register()
642022-10-21T04:23:40.856ZNOTICE: no tofino_dip
652022-10-21T04:23:40.895ZWARNING: tfpkt0: failed to register with tofino
662022-10-21T04:23:40.934ZWARNING: tfport loaded
672022-10-21T04:23:40.972ZWARNING: ext_ip_hak disabled: traffic will be encapsulated
682022-10-21T04:23:41.013Z#################################################
692022-10-21T04:23:41.056Z#### ############# ##
702022-10-21T04:23:41.095Z### ### ############ ##
712022-10-21T04:23:41.134Z## ### # ## ### ## Oxide Computer Company ##
722022-10-21T04:23:41.172Z## ## ## ### # ### ##
732022-10-21T04:23:41.212Z## # ### #### #### This Station Under ##
742022-10-21T04:23:41.250Z### ### #### # ### Computer Control ##
752022-10-21T04:23:41.291Z#### #### ### ## ##
762022-10-21T04:23:41.328Z##################################################
772022-10-21T04:23:41.369ZNOTICE: tfpkt0: tfkt_attach
782022-10-21T04:23:41.407ZNOTICE: tfpkt0: creating tfpkt 0
792022-10-21T04:23:41.543ZNOTICE: tfpkt0: tf_tbus_init
802022-10-21T04:23:41.584ZNOTICE: tofino_tbus_register()
812022-10-21T04:23:41.625ZNOTICE: no tofino_dip
822022-10-21T04:23:41.662ZWARNING: tfpkt0: failed to register with tofino
832022-10-21T04:23:41.703ZHostname: buskin
842022-10-21T04:23:41.740ZLoading smf(7) serice descriptions:
852022-10-21T04:23:41.781Zbuskin console login: Oct 21 04:24:54 bukin tfpkt: NOTICE: unloaded tfpkt:_fini()
862022-10-21T04:23:41.818ZOct 21 04:24:54 buskin tofino: NOTICE: tofino _fini()
872022-10-21T04:23:41.859ZOct 21 04:24:54 buskin tfport: NOTICE: tfport fini() - tfport: 0
882022-10-21T04:23:42.800Zdownloading input: /input/build-end-to-end-tests/work/bootstrap-2d0006fefa6145cd.gz
892022-10-21T04:23:43.856Zdownloaded input: /input/build-end-to-end-tests/work/bootstrap-2d0006fefa6145cd.gz
902022-10-21T04:23:43.886Zdownloading input: /input/build-end-to-end-tests/work/bootstrap.gz
912022-10-21T04:23:55.110Zdownloaded input: /input/build-end-to-end-tests/work/bootstrap.gz
922022-10-21T04:23:55.138Zdownloading input: /input/build-end-to-end-tests/work/end_to_end_tests-5bae6e2638948db4.gz
932022-10-21T04:24:07.013Zdownloaded input: /input/build-end-to-end-tests/work/end_to_end_tests-5bae6e2638948db4.gz
942022-10-21T04:24:07.044Zdownloading input: /input/package/work/package.tar.gz
952022-10-21T04:26:12.347Zdownloaded input: /input/package/work/package.tar.gz
 
962022-10-21T04:26:12.375Zstarting task 0: "setup"
972022-10-21T04:26:12.414Z++ uname -s
982022-10-21T04:26:12.441Z+ kern=SunOS
992022-10-21T04:26:12.469Z+ case "$kern" in
1002022-10-21T04:26:12.497Z+ groupadd -g 12345 build
1012022-10-21T04:26:12.525Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
1022022-10-21T04:26:14.422Z+ zfs create -o mountpoint=/work rpool/work
1032022-10-21T04:26:14.449Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
1042022-10-21T04:26:14.476Z+ home_fs=zfs
1052022-10-21T04:26:14.503Z+ [[ zfs == autofs ]]
1062022-10-21T04:26:14.531Z+ mkdir -p /home/build
1072022-10-21T04:26:14.558Z+ chown build:build /home/build /work
1082022-10-21T04:26:16.451Z+ chmod 0700 /home/build /work
1092022-10-21T04:26:16.478Zprocess exited: duration 4051 ms, exit code 0
 
1102022-10-21T04:26:16.597Zstarting task 1: "authentication"
1112022-10-21T04:26:16.635Zprocess exited: duration 9 ms, exit code 0
 
1122022-10-21T04:26:16.761Zstarting task 2: "build"
1132022-10-21T04:26:16.796Z+ trap _exit_trap EXIT
1142022-10-21T04:26:16.825Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1152022-10-21T04:26:16.994Zsecpolicy_fs_linkdir: 0x55 = 0x55
1162022-10-21T04:26:17.021Zsecpolicy_fs_linkdir+1: 0x8b = 0x48
1172022-10-21T04:26:17.049Zsecpolicy_fs_linkdir+2: 0x15 = 0x89
1182022-10-21T04:26:17.077Zsecpolicy_fs_linkdir+3: 0xd5 = 0xe5
1192022-10-21T04:26:17.105Zsecpolicy_fs_linkdir+4: 0x5a = 0xb8
1202022-10-21T04:26:17.246Zsecpolicy_fs_linkdir+5: 0x29 = 0x1
1212022-10-21T04:26:17.274Zsecpolicy_fs_linkdir+6: 0 = 0x0
1222022-10-21T04:26:17.302Zsecpolicy_fs_linkdir+7: 0xb8 = 0x0
1232022-10-21T04:26:17.329Zsecpolicy_fs_linkdir+8: 0x1 = 0x0
1242022-10-21T04:26:17.357Zsecpolicy_fs_linkdir+9: 0 = 0x5d
1252022-10-21T04:26:17.386Zsecpolicy_fs_linkdir+0xa: 0 = 0xc3
1262022-10-21T04:26:17.414Z+ [[ -d /opt/oxide ]]
1272022-10-21T04:26:17.441Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1282022-10-21T04:26:17.470Z+ pfexec mkdir /opt/oxide
1292022-10-21T04:26:17.498Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1302022-10-21T04:26:17.526Z+ [[ -d /opt/oxide-underneath ]]
1312022-10-21T04:26:17.554Z+ cd /opt/oxide-underneath
1322022-10-21T04:26:17.582Z+ pfexec tar ceEp@/f - .
1332022-10-21T04:26:17.610Z+ cd /opt/oxide
1342022-10-21T04:26:17.638Z+ pfexec tar xveEp@/f -
1352022-10-21T04:26:17.665Zx ., 0 bytes, 0 tape blocks
1362022-10-21T04:26:17.693Zx ./opte, 0 bytes, 0 tape blocks
1372022-10-21T04:26:17.721Zx ./opte/bin, 0 bytes, 0 tape blocks
1382022-10-21T04:26:17.748Zx ./opte/bin/opteadm, 10700744 bytes, 20900 tape blocks
1392022-10-21T04:26:17.775Z+ pfexec rm -rf /opt/oxide-underneath
1402022-10-21T04:26:17.803Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1412022-10-21T04:26:17.831Z+ pfexec mkdir -p /var/oxide
1422022-10-21T04:26:17.859Z+ pfexec mount -F tmpfs -O swap /var/oxide
1432022-10-21T04:26:17.887Z+ pfexec mkdir /opt/oxide/work
1442022-10-21T04:26:17.915Z+ pfexec chown build:build /opt/oxide/work
1452022-10-21T04:26:17.943Z+ cd /opt/oxide/work
1462022-10-21T04:26:17.971Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1472022-10-21T04:26:21.741ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1482022-10-21T04:26:21.802Zx out/maghemite.tar, 92191232 bytes, 180061 tape blocks
1492022-10-21T04:26:21.830Zx out/omicron-sled-agent.tar, 49317888 bytes, 96324 tape blocks
1502022-10-21T04:26:21.858Zx out/clickhouse.tar.gz, 107315581 bytes, 209601 tape blocks
1512022-10-21T04:26:21.892Zx out/cockroachdb.tar.gz, 89482171 bytes, 174770 tape blocks
1522022-10-21T04:26:21.920Zx out/crucible.tar.gz, 37258970 bytes, 72772 tape blocks
1532022-10-21T04:26:21.947Zx out/dendrite-stub.tar.gz, 118142702 bytes, 230748 tape blocks
1542022-10-21T04:26:21.974Zx out/internal-dns.tar.gz, 23773949 bytes, 46434 tape blocks
1552022-10-21T04:26:22.001Zx out/omicron-gateway.tar.gz, 12223519 bytes, 23875 tape blocks
1562022-10-21T04:26:22.031Zx out/omicron-nexus.tar.gz, 35240173 bytes, 68829 tape blocks
1572022-10-21T04:26:22.058Zx out/oximeter-collector.tar.gz, 14568981 bytes, 28456 tape blocks
1582022-10-21T04:26:22.086Zx out/propolis-server.tar.gz, 62492875 bytes, 122057 tape blocks
1592022-10-21T04:26:22.114Zx out/switch-stub.tar.gz, 130363526 bytes, 254617 tape blocks
1602022-10-21T04:26:22.142Zx package-manifest.toml, 6615 bytes, 13 tape blocks
1612022-10-21T04:26:22.170Zx smf/sled-agent/config.toml, 826 bytes, 2 tape blocks
1622022-10-21T04:26:22.197Zx target/release/omicron-package, 46723984 bytes, 91258 tape blocks
1632022-10-21T04:26:22.226Zx tools/create_virtual_hardware.sh, 2750 bytes, 6 tape blocks
1642022-10-21T04:26:22.253Z
1652022-10-21T04:26:22.281Zreal 4.661754121
1662022-10-21T04:26:22.309Zuser 4.146924846
1672022-10-21T04:26:22.337Zsys 0.893566089
1682022-10-21T04:26:22.366Ztrap 0.000139082
1692022-10-21T04:26:22.395Ztflt 0.000000000
1702022-10-21T04:26:22.423Zdflt 0.000000000
1712022-10-21T04:26:22.451Zkflt 0.000000000
1722022-10-21T04:26:22.479Zlock 0.000000000
1732022-10-21T04:26:22.507Zslp 4.177818631
1742022-10-21T04:26:22.535Zlat 0.102862333
1752022-10-21T04:26:22.563Zstop 0.000124090
1762022-10-21T04:26:22.592Z+ mkdir tests
1772022-10-21T04:26:22.620Z+ for p in /input/build-end-to-end-tests/work/*.gz
1782022-10-21T04:26:22.648Z+ ptime -m gunzip
1792022-10-21T04:26:22.676Z++ basename /input/build-end-to-end-tests/work/bootstrap-2d0006fefa6145cd
1802022-10-21T04:26:22.704Z
1812022-10-21T04:26:22.844Zreal 0.136387404
1822022-10-21T04:26:22.871Zuser 0.125555405
1832022-10-21T04:26:22.898Zsys 0.010573754
1842022-10-21T04:26:22.926Ztrap 0.000020370
1852022-10-21T04:26:22.953Ztflt 0.000000000
1862022-10-21T04:26:22.980Zdflt 0.000000000
1872022-10-21T04:26:23.008Zkflt 0.000000000
1882022-10-21T04:26:23.035Zlock 0.000000000
1892022-10-21T04:26:23.063Zslp 0.000018970
1902022-10-21T04:26:23.090Zlat 0.000022049
1912022-10-21T04:26:23.116Zstop 0.000128442
1922022-10-21T04:26:23.143Z++ basename /input/build-end-to-end-tests/work/bootstrap-2d0006fefa6145cd
1932022-10-21T04:26:23.171Z+ chmod a+x tests/bootstrap-2d0006fefa6145cd
1942022-10-21T04:26:23.198Z+ for p in /input/build-end-to-end-tests/work/*.gz
1952022-10-21T04:26:23.225Z+ ptime -m gunzip
1962022-10-21T04:26:23.253Z++ basename /input/build-end-to-end-tests/work/bootstrap
1972022-10-21T04:26:23.280Z
1982022-10-21T04:26:23.307Zreal 1.250363867
1992022-10-21T04:26:23.334Zuser 1.180694736
2002022-10-21T04:26:23.361Zsys 0.069365605
2012022-10-21T04:26:23.388Ztrap 0.000078122
2022022-10-21T04:26:23.415Ztflt 0.000000000
2032022-10-21T04:26:23.442Zdflt 0.000000000
2042022-10-21T04:26:23.469Zkflt 0.000000000
2052022-10-21T04:26:23.496Zlock 0.000000000
2062022-10-21T04:26:23.523Zslp 0.000021160
2072022-10-21T04:26:23.550Zlat 0.000014700
2082022-10-21T04:26:23.578Zstop 0.000121031
2092022-10-21T04:26:23.605Z++ basename /input/build-end-to-end-tests/work/bootstrap
2102022-10-21T04:26:23.632Z+ chmod a+x tests/bootstrap
2112022-10-21T04:26:23.659Z+ for p in /input/build-end-to-end-tests/work/*.gz
2122022-10-21T04:26:23.686Z+ ptime -m gunzip
2132022-10-21T04:26:23.713Z++ basename /input/build-end-to-end-tests/work/end_to_end_tests-5bae6e2638948db4
2142022-10-21T04:26:24.590Z
2152022-10-21T04:26:24.618Zreal 1.427273164
2162022-10-21T04:26:24.645Zuser 1.345679887
2172022-10-21T04:26:24.672Zsys 0.081246339
2182022-10-21T04:26:24.699Ztrap 0.000117133
2192022-10-21T04:26:24.726Ztflt 0.000000000
2202022-10-21T04:26:24.753Zdflt 0.000000000
2212022-10-21T04:26:24.780Zkflt 0.000000000
2222022-10-21T04:26:24.807Zlock 0.000000000
2232022-10-21T04:26:24.835Zslp 0.000017880
2242022-10-21T04:26:24.862Zlat 0.000025400
2252022-10-21T04:26:24.889Zstop 0.000120972
2262022-10-21T04:26:24.916Z++ basename /input/build-end-to-end-tests/work/end_to_end_tests-5bae6e2638948db4
2272022-10-21T04:26:24.945Z+ chmod a+x tests/end_to_end_tests-5bae6e2638948db4
2282022-10-21T04:26:25.084Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2292022-10-21T04:26:25.116Z+++ dirname ./tools/create_virtual_hardware.sh
2302022-10-21T04:26:25.148Z++ cd ./tools
2312022-10-21T04:26:25.179Z++ pwd
2322022-10-21T04:26:25.211Z+ SOURCE_DIR=/opt/oxide/work/tools
2332022-10-21T04:26:25.244Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2342022-10-21T04:26:25.275Z+ MARKER=/etc/opt/oxide/NO_INSTALL
2352022-10-21T04:26:25.306Z+ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2362022-10-21T04:26:25.338Z+ [[ 0 -ge 1 ]]
2372022-10-21T04:26:25.369Z++ dladm show-phys -p -o LINK
2382022-10-21T04:26:25.396Z++ head -1
2392022-10-21T04:26:25.422Z+ PHYSICAL_LINK=igb0
2402022-10-21T04:26:25.659Z+ echo 'Using igb0 as physical link'
2412022-10-21T04:26:25.685ZUsing igb0 as physical link
2422022-10-21T04:26:25.711Z+ ensure_run_as_root
2432022-10-21T04:26:25.737Z++ id -u
2442022-10-21T04:26:25.762Z+ [[ 0 -ne 0 ]]
2452022-10-21T04:26:25.788Z+ ensure_zpools
2462022-10-21T04:26:25.813Z+ readarray -t ZPOOLS
2472022-10-21T04:26:25.838Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/config.toml
2482022-10-21T04:26:25.864Z++ sed 's/[ ",]//g'
2492022-10-21T04:26:25.889Z+ for ZPOOL in "${ZPOOLS[@]}"
2502022-10-21T04:26:25.915Z+ VDEV_PATH=/opt/oxide/work/tools/../oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2512022-10-21T04:26:25.941Z+ [[ -f /opt/oxide/work/tools/../oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2522022-10-21T04:26:25.967Z+ dd if=/dev/zero of=/opt/oxide/work/tools/../oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=10G
2532022-10-21T04:26:25.993Z0+0 records in
2542022-10-21T04:26:26.018Z0+0 records out
2552022-10-21T04:26:26.044Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2562022-10-21T04:26:26.070Z+ success 'ZFS vdev /opt/oxide/work/tools/../oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2572022-10-21T04:26:26.201Z+ set +x
2582022-10-21T04:26:26.227ZZFS vdev /opt/oxide/work/tools/../oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2592022-10-21T04:26:26.253Z++ zpool list -o name
2602022-10-21T04:26:26.279Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2612022-10-21T04:26:26.305Z+ [[ -z '' ]]
2622022-10-21T04:26:26.330Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /opt/oxide/work/tools/../oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2632022-10-21T04:26:26.356Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2642022-10-21T04:26:26.382Z+ set +x
2652022-10-21T04:26:26.408ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2662022-10-21T04:26:26.434Z+ for ZPOOL in "${ZPOOLS[@]}"
2672022-10-21T04:26:26.461Z+ VDEV_PATH=/opt/oxide/work/tools/../oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2682022-10-21T04:26:26.487Z+ [[ -f /opt/oxide/work/tools/../oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2692022-10-21T04:26:26.513Z+ dd if=/dev/zero of=/opt/oxide/work/tools/../oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=10G
2702022-10-21T04:26:26.540Z0+0 records in
2712022-10-21T04:26:26.566Z0+0 records out
2722022-10-21T04:26:26.592Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2732022-10-21T04:26:26.618Z+ success 'ZFS vdev /opt/oxide/work/tools/../oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2742022-10-21T04:26:26.644Z+ set +x
2752022-10-21T04:26:26.671ZZFS vdev /opt/oxide/work/tools/../oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
2762022-10-21T04:26:26.697Z++ zpool list -o name
2772022-10-21T04:26:26.723Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
2782022-10-21T04:26:26.749Z+ [[ -z '' ]]
2792022-10-21T04:26:26.775Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /opt/oxide/work/tools/../oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2802022-10-21T04:26:26.833Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
2812022-10-21T04:26:26.859ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
2822022-10-21T04:26:26.885Z+ set +x
2832022-10-21T04:26:26.912Z+ for ZPOOL in "${ZPOOLS[@]}"
2842022-10-21T04:26:26.937Z+ VDEV_PATH=/opt/oxide/work/tools/../oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2852022-10-21T04:26:26.962Z+ [[ -f /opt/oxide/work/tools/../oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2862022-10-21T04:26:26.988Z+ dd if=/dev/zero of=/opt/oxide/work/tools/../oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=10G
2872022-10-21T04:26:27.013Z0+0 records in
2882022-10-21T04:26:27.039Z0+0 records out
2892022-10-21T04:26:27.065Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2902022-10-21T04:26:27.091Z+ success 'ZFS vdev /opt/oxide/work/tools/../oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2912022-10-21T04:26:27.117Z+ set +x
2922022-10-21T04:26:27.142ZZFS vdev /opt/oxide/work/tools/../oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
2932022-10-21T04:26:27.167Z++ zpool list -o name
2942022-10-21T04:26:27.192Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
2952022-10-21T04:26:27.317Z+ [[ -z '' ]]
2962022-10-21T04:26:27.343Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /opt/oxide/work/tools/../oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2972022-10-21T04:26:27.369Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
2982022-10-21T04:26:27.395Z+ set +x
2992022-10-21T04:26:27.421ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3002022-10-21T04:26:27.447Z+ ensure_simulated_chelsios igb0
3012022-10-21T04:26:27.473Z+ local PHYSICAL_LINK=igb0
3022022-10-21T04:26:27.500Z+ VNIC_NAMES=("net0" "net1")
3032022-10-21T04:26:27.526Z+ for VNIC in "${VNIC_NAMES[@]}"
3042022-10-21T04:26:27.552Z++ get_vnic_name_if_exists net0
3052022-10-21T04:26:27.578Z++ dladm show-vnic -p -o LINK net0
3062022-10-21T04:26:27.605Z++ echo ''
3072022-10-21T04:26:27.631Z+ [[ -z '' ]]
3082022-10-21T04:26:27.657Z+ dladm create-vnic -t -l igb0 net0
3092022-10-21T04:26:27.683Z+ success 'VNIC net0 exists'
3102022-10-21T04:26:27.709Z+ set +x
3112022-10-21T04:26:27.735ZVNIC net0 exists
3122022-10-21T04:26:27.761Z+ for VNIC in "${VNIC_NAMES[@]}"
3132022-10-21T04:26:27.936Z++ get_vnic_name_if_exists net1
3142022-10-21T04:26:27.962Z++ dladm show-vnic -p -o LINK net1
3152022-10-21T04:26:27.989Z++ echo ''
3162022-10-21T04:26:28.015Z+ [[ -z '' ]]
3172022-10-21T04:26:28.040Z+ dladm create-vnic -t -l igb0 net1
3182022-10-21T04:26:28.066Z+ success 'VNIC net1 exists'
 
3192022-10-21T04:26:28.077ZOct 21 04:27:44 bukin xde: WARNING: ext_ip_hack enabled: traffic will NOT be encapsulated
 
3202022-10-21T04:26:28.092Z+ set +x
3212022-10-21T04:26:28.123ZVNIC net1 exists
3222022-10-21T04:26:28.584Z
3232022-10-21T04:26:28.611Zreal 0.219191011
3242022-10-21T04:26:28.637Zuser 0.045510652
3252022-10-21T04:26:28.663Zsys 0.162682158
3262022-10-21T04:26:28.689Ztrap 0.000001138
3272022-10-21T04:26:28.715Ztflt 0.000000000
3282022-10-21T04:26:28.741Zdflt 0.000000000
3292022-10-21T04:26:28.767Zkflt 0.000000000
3302022-10-21T04:26:28.793Zlock 0.000000000
3312022-10-21T04:26:28.818Zslp 0.389256530
3322022-10-21T04:26:28.844Zlat 0.000370436
3332022-10-21T04:26:28.870Zstop 0.000231502
3342022-10-21T04:26:28.895Z+ pfexec mkdir -p /usr/oxide
3352022-10-21T04:26:28.921Z+ pfexec rm -f /usr/oxide/tcpproxy
3362022-10-21T04:26:28.947Z+ pfexec curl -sSfL -o /usr/oxide/tcpproxy http://catacomb.eng.oxide.computer:12346/tcpproxy
3372022-10-21T04:26:28.974Z+ pfexec chmod +x /usr/oxide/tcpproxy
3382022-10-21T04:26:29.000Z+ pfexec rm -f /var/svc/manifest/site/tcpproxy.xml
3392022-10-21T04:26:29.026Z+ pfexec curl -sSfL -o /var/svc/manifest/site/tcpproxy.xml http://catacomb.eng.oxide.computer:12346/tcpproxy.xml
3402022-10-21T04:26:29.200Z+ pfexec svccfg import /var/svc/manifest/site/tcpproxy.xml
3412022-10-21T04:26:29.227Z+ pfexec ipadm create-addr -T static -a 192.168.1.199/24 igb0/sidehatch
3422022-10-21T04:26:29.254Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
3432022-10-21T04:26:29.281Z++ dladm show-phys -m -p -o ADDRESS
3442022-10-21T04:26:29.307Z++ head -n 1
3452022-10-21T04:26:29.334Z+ sed -e '/\[gateway\]/,/\[request\]/ s/^.*address =.*$/address = "192.168.1.199"/' -e 's/^mac =.*$/mac = "18:c0:4d:d:9f:b2"/' -i pkg/config-rss.toml
3462022-10-21T04:26:29.361Z+ tar rf out/omicron-sled-agent.tar pkg/config-rss.toml
3472022-10-21T04:26:29.388Z+ rm -rf pkg
3482022-10-21T04:26:29.416Z+ OMICRON_NO_UNINSTALL=1
3492022-10-21T04:26:29.552Z+ ptime -m pfexec ./target/release/omicron-package install
3502022-10-21T04:26:29.579ZOct 21 04:27:42.970 DEBG target: Target({"switch_variant": "stub"})
3512022-10-21T04:26:29.606ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/clickhouse.tar.gz, src: out/clickhouse.tar.gz
3522022-10-21T04:26:29.633ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/cockroachdb.tar.gz, src: out/cockroachdb.tar.gz
3532022-10-21T04:26:29.660ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/sled-agent.tar, src: out/omicron-sled-agent.tar
3542022-10-21T04:26:29.687ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/propolis-server.tar.gz, src: out/propolis-server.tar.gz
3552022-10-21T04:26:29.714ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/switch.tar.gz, src: out/switch-stub.tar.gz
3562022-10-21T04:26:29.741ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/mg-ddm.tar, src: out/maghemite.tar
3572022-10-21T04:26:29.769ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/crucible.tar.gz, src: out/crucible.tar.gz
3582022-10-21T04:26:29.795ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/internal-dns.tar.gz, src: out/internal-dns.tar.gz
3592022-10-21T04:26:29.822ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/nexus.tar.gz, src: out/omicron-nexus.tar.gz
3602022-10-21T04:26:29.848ZOct 21 04:27:42.972 INFO Installing service, dst: /opt/oxide/oximeter.tar.gz, src: out/oximeter-collector.tar.gz
3612022-10-21T04:26:29.875ZOct 21 04:27:43.134 INFO Unpacking service tarball, service_path: /opt/oxide/mg-ddm, tar_path: /opt/oxide/mg-ddm.tar
3622022-10-21T04:26:29.901ZOct 21 04:27:43.185 INFO Unpacking service tarball, service_path: /opt/oxide/sled-agent, tar_path: /opt/oxide/sled-agent.tar
3632022-10-21T04:26:29.929ZOct 21 04:27:43.212 INFO Installing boostrap service from /opt/oxide/sled-agent/pkg/manifest.xml
3642022-10-21T04:26:29.955Z
3652022-10-21T04:26:29.982Zreal 0.378106350
3662022-10-21T04:26:30.009Zuser 0.069531338
3672022-10-21T04:26:30.037Zsys 1.156534137
3682022-10-21T04:26:30.063Ztrap 0.000001369
3692022-10-21T04:26:30.089Ztflt 0.000030449
3702022-10-21T04:26:30.116Zdflt 0.000238199
 
3712022-10-21T04:26:30.135ZOct 21 04:27:46 buskin tfport: WARNING: tfport loaded
 
3722022-10-21T04:26:30.142Zkflt 0.000001429
3732022-10-21T04:26:30.169Zlock 34.217227203
 
3742022-10-21T04:26:30.174ZOct 21 04:27:46 buskin tfpkt: NOTICE: tfpkt0: tfpkt_attach
 
3752022-10-21T04:26:30.196Zslp 0.592246459
 
3762022-10-21T04:26:30.216ZOct 21 04:27:46 buskin tfpkt: NOTICE: tfpkt0: creating tfpkt 0
 
3772022-10-21T04:26:30.223Zlat 0.002537757
 
3782022-10-21T04:26:30.253ZOct 21 04:27:46 buskin tfpkt: NOTICE: tfpkt0: tf_tbus_init
 
3792022-10-21T04:26:30.255Zstop 0.188539199
3802022-10-21T04:26:30.282Z+ ./tests/bootstrap
 
3812022-10-21T04:26:30.295ZOct 21 04:27:46 buskin tofino: NOTICE: tofino_tbus_register()
 
3822022-10-21T04:26:30.309Zwaiting for nexus to come up...
 
3832022-10-21T04:26:30.330ZOct 21 04:27:46 buskin tofino: NOTICE: no tofino_dip
3842022-10-21T04:26:30.364ZOct 21 04:27:46 buskin tfpkt: WARNING: tfpkt0: failed to register with tofino
 
3852022-10-21T04:27:32.514Zcreating IP pool...
3862022-10-21T04:27:32.546Zensuring datasets are ready...
3872022-10-21T04:27:56.765Zlet's roll.
3882022-10-21T04:27:56.793Z+ rm ./tests/bootstrap
3892022-10-21T04:27:56.819Z+ for test_bin in tests/*
3902022-10-21T04:27:56.846Z+ ./tests/bootstrap-2d0006fefa6145cd
3912022-10-21T04:27:56.873Z
3922022-10-21T04:27:56.899Zrunning 0 tests
3932022-10-21T04:27:56.926Z
3942022-10-21T04:27:56.952Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
3952022-10-21T04:27:56.980Z
3962022-10-21T04:27:57.007Z+ for test_bin in tests/*
3972022-10-21T04:27:57.034Z+ ./tests/end_to_end_tests-5bae6e2638948db4
3982022-10-21T04:27:57.061Z
3992022-10-21T04:27:57.088Zrunning 1 test
 
4002022-10-21T04:27:58.391ZOct 21 04:29:14 bukin xde: WARNING: disabling overlay for port: opte0
 
4012022-10-21T04:28:56.791Ztest instance_launch::instance_launch has been running for over 60 seconds
4022022-10-21T04:29:50.075Ztest instance_launch::instance_launch ... ok
4032022-10-21T04:29:50.102Z
4042022-10-21T04:29:50.129Ztest result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 113.29s
4052022-10-21T04:29:50.155Z
4062022-10-21T04:29:50.182Z+ _exit_trap
4072022-10-21T04:29:50.209Z+ local status=0
4082022-10-21T04:29:50.514Z+ [[ 0 -eq 0 ]]
4092022-10-21T04:29:50.540Z+ exit 0
4102022-10-21T04:29:50.565Zprocess exited: duration 213288 ms, exit code 0
 
4112022-10-21T04:29:50.866Zfound 2 output files
4122022-10-21T04:29:50.892Zuploading: /var/svc/log/system-illumos-sled-agent:default.log (186520 bytes)
4132022-10-21T04:29:50.924Zuploaded: /var/svc/log/system-illumos-sled-agent:default.log
4142022-10-21T04:29:50.950Zuploading: /zone/oxz_nexus/root/var/svc/log/system-illumos-nexus:default.log (172043 bytes)
4152022-10-21T04:29:51.097Zuploaded: /zone/oxz_nexus/root/var/svc/log/system-illumos-nexus:default.log