01J43PTMCHRWCNPBMGSW2KZGRZ: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.33",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01J43PVBSEXJWEC5ET6XXD2VCV

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-07-31T06:45:53.294Zjob dependencies complete; ready to run (waiting for 30 m 38 s)
22024-07-31T06:45:53.297Zjob assigned to worker 01J43QX6N7HBXRYBPJA964S26S (queued for 0 s)
32024-07-31T06:45:53.479Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-07-31T06:45:53.529Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-07-31T06:45:53.567Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-07-31T06:45:53.601Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-07-31T06:45:53.634Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-07-31T06:45:53.668ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-07-31T06:45:53.701Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d3
102024-07-31T06:45:53.734ZOxide Helios Version helios-2.0.22764 64-bit
112024-07-31T06:45:53.768ZConfiguring devices.
122024-07-31T06:45:53.801Z##################################################
132024-07-31T06:45:53.835Z#### ############# ##
142024-07-31T06:45:53.868Z### ### ############ ##
152024-07-31T06:45:53.901Z## ### # ## ### ## Oxide Computer Company ##
162024-07-31T06:45:53.935Z## ## ## ### # ### ##
172024-07-31T06:45:53.968Z## # ### #### #### This Station Under ##
182024-07-31T06:45:54.044Z### ### #### # ### Computer Control ##
192024-07-31T06:45:54.080Z#### #### ### ## ##
202024-07-31T06:45:54.113Z##################################################
212024-07-31T06:45:54.147ZHostname: buskin
222024-07-31T06:45:54.180ZLoading smf(7) service descriptions:
232024-07-31T06:45:54.656Zdownloading input: /input/package/work/package.tar.gz
242024-07-31T06:49:45.525Zdownloaded input: /input/package/work/package.tar.gz
 
252024-07-31T06:49:45.549Zstarting task 0: "setup"
262024-07-31T06:49:45.549Z++ uname -s
272024-07-31T06:49:45.549Z+ kern=SunOS
282024-07-31T06:49:45.549Z+ case "$kern" in
292024-07-31T06:49:45.549Z+ groupadd -g 12345 build
302024-07-31T06:49:45.549Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-07-31T06:49:47.543Z+ zfs create -o mountpoint=/work rpool/work
322024-07-31T06:49:47.591Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-07-31T06:49:47.616Z+ home_fs=zfs
342024-07-31T06:49:47.616Z+ [[ zfs == autofs ]]
352024-07-31T06:49:47.616Z+ mkdir -p /home/build
362024-07-31T06:49:47.616Z+ chown build:build /home/build /work
372024-07-31T06:49:49.599Z+ chmod 0700 /home/build /work
382024-07-31T06:49:49.624Zprocess exited: duration 4077 ms, exit code 0
 
392024-07-31T06:49:49.672Zstarting task 1: "authentication"
402024-07-31T06:49:49.715Zprocess exited: duration 43 ms, exit code 0
 
412024-07-31T06:49:49.762Zstarting task 2: "build"
422024-07-31T06:49:49.786Z+ trap _exit_trap EXIT
432024-07-31T06:49:49.786Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-07-31T06:49:49.881Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-07-31T06:49:49.881Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-07-31T06:49:49.881Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-07-31T06:49:49.881Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-07-31T06:49:49.881Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-07-31T06:49:49.881Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-07-31T06:49:49.881Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-07-31T06:49:49.881Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-07-31T06:49:49.905Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-07-31T06:49:49.905Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-07-31T06:49:49.905Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-07-31T06:49:49.905Z+ [[ -d /opt/oxide ]]
562024-07-31T06:49:49.905Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-07-31T06:49:49.905Z+ pfexec mkdir /opt/oxide
582024-07-31T06:49:49.905Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-07-31T06:49:49.905Z+ [[ -d /opt/oxide-underneath ]]
602024-07-31T06:49:49.905Z+ cd /opt/oxide-underneath
612024-07-31T06:49:49.905Z+ pfexec tar ceEp@/f - .
622024-07-31T06:49:49.905Z+ cd /opt/oxide
632024-07-31T06:49:49.905Z+ pfexec tar xveEp@/f -
642024-07-31T06:49:50.013Zx ., 0 bytes, 0 tape blocks
652024-07-31T06:49:50.013Zx ./opte, 0 bytes, 0 tape blocks
662024-07-31T06:49:50.013Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-07-31T06:49:50.013Zx ./opte/bin/opteadm, 53012184 bytes, 103540 tape blocks
682024-07-31T06:49:50.037Z+ pfexec rm -rf /opt/oxide-underneath
692024-07-31T06:49:50.037Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-07-31T06:49:50.061Z+ pfexec mkdir /opt/oxide/work
712024-07-31T06:49:50.061Z+ pfexec chown build:build /opt/oxide/work
722024-07-31T06:49:50.061Z+ cd /opt/oxide/work
732024-07-31T06:49:50.061Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-07-31T06:50:00.606ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-07-31T06:50:00.606Zx out/target/test, 75 bytes, 1 tape blocks
762024-07-31T06:50:00.606Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-07-31T06:50:00.606Zx package-manifest.toml, 30053 bytes, 59 tape blocks
782024-07-31T06:50:00.607Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-07-31T06:50:00.607Zx target/release/omicron-package, 33259544 bytes, 64961 tape blocks
802024-07-31T06:50:00.607Zx target/release/xtask, 11752112 bytes, 22954 tape blocks
812024-07-31T06:50:00.607Zx target/debug/bootstrap, 199422328 bytes, 389497 tape blocks
822024-07-31T06:50:00.607Zx tests/bootstrap-468fdec28d591750, 24563680 bytes, 47976 tape blocks
832024-07-31T06:50:00.607Zx tests/commtest-514666b6015de861, 25307536 bytes, 49429 tape blocks
842024-07-31T06:50:00.607Zx tests/dhcp_server-69cc2fc5d974a558, 24563760 bytes, 47977 tape blocks
852024-07-31T06:50:00.607Zx tests/end_to_end_tests-0133cc9faedf70dd, 206215640 bytes, 402765 tape blocks
862024-07-31T06:50:00.607Zx out/clickhouse.tar.gz, 228507330 bytes, 446304 tape blocks
872024-07-31T06:50:00.607Zx out/clickhouse_keeper.tar.gz, 228489398 bytes, 446269 tape blocks
882024-07-31T06:50:00.607Zx out/cockroachdb.tar.gz, 135037905 bytes, 263746 tape blocks
892024-07-31T06:50:00.607Zx out/crucible-dtrace.tar, 85504 bytes, 167 tape blocks
902024-07-31T06:50:00.607Zx out/crucible-pantry-zone.tar.gz, 28505110 bytes, 55675 tape blocks
912024-07-31T06:50:00.607Zx out/crucible-zone.tar.gz, 39070231 bytes, 76310 tape blocks
922024-07-31T06:50:00.607Zx out/external-dns.tar.gz, 25853347 bytes, 50495 tape blocks
932024-07-31T06:50:00.607Zx out/internal-dns.tar.gz, 25852817 bytes, 50494 tape blocks
942024-07-31T06:50:00.607Zx out/mg-ddm-gz.tar, 62081536 bytes, 121253 tape blocks
952024-07-31T06:50:00.607Zx out/nexus.tar.gz, 88374141 bytes, 172606 tape blocks
962024-07-31T06:50:00.607Zx out/ntp.tar.gz, 9201932 bytes, 17973 tape blocks
972024-07-31T06:50:00.607Zx out/omicron-gateway-softnpu.tar.gz, 14154975 bytes, 27647 tape blocks
982024-07-31T06:50:00.607Zx out/omicron-sled-agent.tar, 99486720 bytes, 194310 tape blocks
992024-07-31T06:50:00.607Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1002024-07-31T06:50:00.607Zx out/oximeter.tar.gz, 43725597 bytes, 85402 tape blocks
1012024-07-31T06:50:00.607Zx out/oxlog.tar, 3017216 bytes, 5893 tape blocks
1022024-07-31T06:50:00.607Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1032024-07-31T06:50:00.607Zx out/propolis-server.tar.gz, 66857321 bytes, 130581 tape blocks
1042024-07-31T06:50:00.607Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1052024-07-31T06:50:00.607Zx out/switch-softnpu.tar.gz, 209192638 bytes, 408580 tape blocks
1062024-07-31T06:50:00.631Z
1072024-07-31T06:50:00.631Zreal 10.529818609
1082024-07-31T06:50:00.631Zuser 9.351696754
1092024-07-31T06:50:00.632Zsys 2.020154992
1102024-07-31T06:50:00.632Ztrap 0.000417740
1112024-07-31T06:50:00.632Ztflt 0.000000000
1122024-07-31T06:50:00.632Zdflt 0.000000000
1132024-07-31T06:50:00.632Zkflt 0.000000000
1142024-07-31T06:50:00.632Zlock 0.000000000
1152024-07-31T06:50:00.632Zslp 9.430002047
1162024-07-31T06:50:00.632Zlat 0.255284893
1172024-07-31T06:50:00.632Zstop 0.000129733
1182024-07-31T06:50:00.632Z+ bmat address ls
1192024-07-31T06:50:00.632ZNAME CIDR FIRST LAST COUNT
1202024-07-31T06:50:00.632Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1212024-07-31T06:50:00.632Z++ bmat address ls -f extra -Ho first,last,count
1222024-07-31T06:50:00.632Z+ set -- 10.151.1.164 10.151.1.227 64
1232024-07-31T06:50:00.632Z+ EXTRA_IP_START=10.151.1.164
1242024-07-31T06:50:00.632Z+ EXTRA_IP_END=10.151.1.227
1252024-07-31T06:50:00.632Z+ EXTRA_IP_COUNT=64
1262024-07-31T06:50:00.632Z+ (( EXTRA_IP_COUNT >= 32 ))
1272024-07-31T06:50:00.632Z+ EXTRA_IP_BASE=10.151.1
1282024-07-31T06:50:00.632Z+ EXTRA_IP_FOCTET=164
1292024-07-31T06:50:00.632Z+ EXTRA_IP_LOCTET=227
1302024-07-31T06:50:00.632Z+ SERVICE_IP_POOL_START=10.151.1.164
1312024-07-31T06:50:00.632Z+ SERVICE_IP_POOL_END=10.151.1.173
1322024-07-31T06:50:00.632Z+ DNS_IP1=10.151.1.164
1332024-07-31T06:50:00.632Z+ DNS_IP2=10.151.1.165
1342024-07-31T06:50:00.632Z+ UPLINK_IP=10.151.1.174
1352024-07-31T06:50:00.632Z+ IPPOOL_START=10.151.1.175
1362024-07-31T06:50:00.632Z+ IPPOOL_END=10.151.1.227
1372024-07-31T06:50:00.632Z++ ipadm show-addr -po type,addr
1382024-07-31T06:50:00.632Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1392024-07-31T06:50:00.632Z+ GATEWAY_IP=10.151.1.100
1402024-07-31T06:50:00.632Z+ [[ -n 10.151.1.100 ]]
1412024-07-31T06:50:00.632Z+ ping -s 10.151.1.100 56 1
1422024-07-31T06:50:00.632ZPING 10.151.1.100: 56 data bytes
1432024-07-31T06:50:00.632Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
1442024-07-31T06:50:00.632Z
1452024-07-31T06:50:00.632Z----10.151.1.100 PING Statistics----
1462024-07-31T06:50:00.632Z1 packets transmitted, 1 packets received, 0% packet loss
1472024-07-31T06:50:00.632Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
1482024-07-31T06:50:00.633Z++ arp -an
1492024-07-31T06:50:00.633Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1502024-07-31T06:50:00.657Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1512024-07-31T06:50:00.657Z+ routeadm -e ipv4-forwarding -u
1522024-07-31T06:50:00.745Z+ PXA_START=10.151.1.164
1532024-07-31T06:50:00.745Z+ PXA_END=10.151.1.227
1542024-07-31T06:50:00.769Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1552024-07-31T06:50:00.880Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1562024-07-31T06:50:00.904ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1572024-07-31T06:50:00.957Zcreating virtual hardware
1582024-07-31T06:50:00.981Zcreating /scratch/m2_0.vdev
1592024-07-31T06:50:00.981Zcreating /scratch/m2_1.vdev
1602024-07-31T06:50:00.981Zcreating /scratch/u2_0.vdev
1612024-07-31T06:50:00.981Zcreating /scratch/u2_1.vdev
1622024-07-31T06:50:00.981Zcreating /scratch/u2_2.vdev
1632024-07-31T06:50:00.981Zcreating /scratch/u2_3.vdev
1642024-07-31T06:50:00.981Zcreating /scratch/u2_4.vdev
1652024-07-31T06:50:00.981Zcreating /scratch/u2_5.vdev
1662024-07-31T06:50:00.981Zcreating /scratch/u2_6.vdev
1672024-07-31T06:50:00.981Zcreating /scratch/u2_7.vdev
1682024-07-31T06:50:00.981Zcreating /scratch/u2_8.vdev
1692024-07-31T06:50:01.015ZSimnet net0/sc0_0 exists
1702024-07-31T06:50:01.038ZSimnet net1/sc1_0 exists
1712024-07-31T06:50:01.062ZVnic sc0_1 exists
1722024-07-31T06:50:13.445ZUsing 10.151.1.100 as gateway ip
1732024-07-31T06:50:13.446Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1742024-07-31T06:50:13.446Zconfiguring SoftNPU ARP entry
1752024-07-31T06:50:13.474Zconfiguring SoftNPU proxy ARP
1762024-07-31T06:50:13.529ZSoftNPU state:
1772024-07-31T06:50:13.529Z local v6:
1782024-07-31T06:50:13.529Z local v4:
1792024-07-31T06:50:13.529Z router v6:
1802024-07-31T06:50:13.529Z router v4_idx:
1812024-07-31T06:50:13.529Z router v4_routes:
1822024-07-31T06:50:13.529Z resolver v4:
1832024-07-31T06:50:13.529Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1842024-07-31T06:50:13.529Z resolver v6:
1852024-07-31T06:50:13.529Z nat v4:
1862024-07-31T06:50:13.529Z nat_v6:
1872024-07-31T06:50:13.529Z port_mac:
1882024-07-31T06:50:13.529Z proxy arp:
1892024-07-31T06:50:13.529Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
1902024-07-31T06:50:13.529Zcreated virtual hardware
1912024-07-31T06:50:13.553Z
1922024-07-31T06:50:13.553Zreal 12.646537221
1932024-07-31T06:50:13.553Zuser 0.657492808
1942024-07-31T06:50:13.553Zsys 3.171686425
1952024-07-31T06:50:13.553Ztrap 0.000051395
1962024-07-31T06:50:13.553Ztflt 0.000221749
1972024-07-31T06:50:13.553Zdflt 0.000823902
1982024-07-31T06:50:13.553Zkflt 0.000008510
1992024-07-31T06:50:13.554Zlock 9:45.669840668
2002024-07-31T06:50:13.554Zslp 38.282477123
2012024-07-31T06:50:13.554Zlat 0.067587909
2022024-07-31T06:50:13.554Zstop 0.346164282
2032024-07-31T06:50:13.554Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2042024-07-31T06:50:13.599Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2052024-07-31T06:50:13.599Z+ diff -u pkg/config.toml~ pkg/config.toml
2062024-07-31T06:50:13.599Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2072024-07-31T06:50:13.599Z+++ pkg/config.toml Wed Jul 31 06:50:13 2024
2082024-07-31T06:50:13.599Z@@ -29,18 +29,18 @@
2092024-07-31T06:50:13.599Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2102024-07-31T06:50:13.599Z # followed by a string that is embedded into their fake serial values.
2112024-07-31T06:50:13.599Z vdevs = [
2122024-07-31T06:50:13.600Z- "m2_0.vdev",
2132024-07-31T06:50:13.600Z- "m2_1.vdev",
2142024-07-31T06:50:13.600Z+ "/scratch/m2_0.vdev",
2152024-07-31T06:50:13.600Z+ "/scratch/m2_1.vdev",
2162024-07-31T06:50:13.600Z
2172024-07-31T06:50:13.600Z- "u2_0.vdev",
2182024-07-31T06:50:13.600Z- "u2_1.vdev",
2192024-07-31T06:50:13.600Z- "u2_2.vdev",
2202024-07-31T06:50:13.600Z- "u2_3.vdev",
2212024-07-31T06:50:13.600Z- "u2_4.vdev",
2222024-07-31T06:50:13.600Z- "u2_5.vdev",
2232024-07-31T06:50:13.600Z- "u2_6.vdev",
2242024-07-31T06:50:13.600Z- "u2_7.vdev",
2252024-07-31T06:50:13.600Z- "u2_8.vdev",
2262024-07-31T06:50:13.600Z+ "/scratch/u2_0.vdev",
2272024-07-31T06:50:13.600Z+ "/scratch/u2_1.vdev",
2282024-07-31T06:50:13.600Z+ "/scratch/u2_2.vdev",
2292024-07-31T06:50:13.600Z+ "/scratch/u2_3.vdev",
2302024-07-31T06:50:13.600Z+ "/scratch/u2_4.vdev",
2312024-07-31T06:50:13.600Z+ "/scratch/u2_5.vdev",
2322024-07-31T06:50:13.600Z+ "/scratch/u2_6.vdev",
2332024-07-31T06:50:13.600Z+ "/scratch/u2_7.vdev",
2342024-07-31T06:50:13.600Z+ "/scratch/u2_8.vdev",
2352024-07-31T06:50:13.600Z ]
2362024-07-31T06:50:13.600Z
2372024-07-31T06:50:13.600Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2382024-07-31T06:50:13.600Z+ true
2392024-07-31T06:50:13.600Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2402024-07-31T06:50:13.600Z+ SILO_NAME=recovery
2412024-07-31T06:50:13.600Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2422024-07-31T06:50:13.600Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2432024-07-31T06:50:13.600Z+ sed -i~ '
2442024-07-31T06:50:13.600Z /^external_dns_ips/c\
2452024-07-31T06:50:13.600Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2462024-07-31T06:50:13.600Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2472024-07-31T06:50:13.600Z /^first/c\
2482024-07-31T06:50:13.600Zfirst = "10.151.1.164"
2492024-07-31T06:50:13.600Z /^last/c\
2502024-07-31T06:50:13.600Zlast = "10.151.1.173"
2512024-07-31T06:50:13.600Z }
2522024-07-31T06:50:13.601Z /^infra_ip_first/c\
2532024-07-31T06:50:13.601Zinfra_ip_first = "10.151.1.174"
2542024-07-31T06:50:13.601Z /^infra_ip_last/c\
2552024-07-31T06:50:13.601Zinfra_ip_last = "10.151.1.174"
2562024-07-31T06:50:13.601Z /^\[\[rack_network_config.ports/,/^$/ {
2572024-07-31T06:50:13.601Z /^routes/c\
2582024-07-31T06:50:13.601Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2592024-07-31T06:50:13.601Z /^addresses/c\
2602024-07-31T06:50:13.601Zaddresses = \[{address = "10.151.1.174/24"} \]
2612024-07-31T06:50:13.601Z }
2622024-07-31T06:50:13.601Z' pkg/config-rss.toml
2632024-07-31T06:50:13.601Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2642024-07-31T06:50:13.601Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2652024-07-31T06:50:13.601Z+++ pkg/config-rss.toml Wed Jul 31 06:50:13 2024
2662024-07-31T06:50:13.601Z@@ -33,7 +33,7 @@
2672024-07-31T06:50:13.601Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2682024-07-31T06:50:13.601Z # must be contained in one of the "internal services" IP Pool ranges listed
2692024-07-31T06:50:13.601Z # below.
2702024-07-31T06:50:13.601Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2712024-07-31T06:50:13.601Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2722024-07-31T06:50:13.601Z
2732024-07-31T06:50:13.601Z # Initial TLS certificates for the external API
2742024-07-31T06:50:13.601Z #
2752024-07-31T06:50:13.601Z@@ -69,8 +69,8 @@
2762024-07-31T06:50:13.601Z #
2772024-07-31T06:50:13.601Z # For more on this and what to put here, see docs/how-to-run.adoc.
2782024-07-31T06:50:13.601Z [[internal_services_ip_pool_ranges]]
2792024-07-31T06:50:13.601Z-first = "192.168.1.20"
2802024-07-31T06:50:13.601Z-last = "192.168.1.29"
2812024-07-31T06:50:13.601Z+first = "10.151.1.164"
2822024-07-31T06:50:13.601Z+last = "10.151.1.173"
2832024-07-31T06:50:13.601Z
2842024-07-31T06:50:13.601Z # TODO - this configuration is subject to change going forward. Ultimately these
2852024-07-31T06:50:13.601Z # parameters should be provided to the control plane via wicket, but we need to
2862024-07-31T06:50:13.601Z@@ -91,8 +91,8 @@
2872024-07-31T06:50:13.601Z # A range of IP addresses used by Boundary Services on the external network. In
2882024-07-31T06:50:13.601Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2892024-07-31T06:50:13.601Z # With softnpu, only one address is used.
2902024-07-31T06:50:13.601Z-infra_ip_first = "192.168.1.30"
2912024-07-31T06:50:13.602Z-infra_ip_last = "192.168.1.30"
2922024-07-31T06:50:13.602Z+infra_ip_first = "10.151.1.174"
2932024-07-31T06:50:13.602Z+infra_ip_last = "10.151.1.174"
2942024-07-31T06:50:13.602Z
2952024-07-31T06:50:13.602Z # Configurations for BGP routers to run on the scrimlets.
2962024-07-31T06:50:13.602Z bgp = []
2972024-07-31T06:50:13.602Z@@ -100,9 +100,9 @@
2982024-07-31T06:50:13.602Z # You can configure multiple uplinks by repeating the following stanza
2992024-07-31T06:50:13.602Z [[rack_network_config.ports]]
3002024-07-31T06:50:13.602Z # Routes associated with this port.
3012024-07-31T06:50:13.602Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3022024-07-31T06:50:13.602Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3032024-07-31T06:50:13.602Z # Addresses associated with this port.
3042024-07-31T06:50:13.626Z-addresses = [{address = "192.168.1.30/24"}]
3052024-07-31T06:50:13.626Z+addresses = [{address = "10.151.1.174/24"} ]
3062024-07-31T06:50:13.626Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3072024-07-31T06:50:13.626Z port = "qsfp0"
3082024-07-31T06:50:13.626Z # The speed of this port.
3092024-07-31T06:50:13.626Z+ true
3102024-07-31T06:50:13.626Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3112024-07-31T06:50:13.626Za pkg/config-rss.toml 7K
3122024-07-31T06:50:13.626Za pkg/config.toml 4K
3132024-07-31T06:50:13.626Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3142024-07-31T06:50:13.626Z+ TLS_NAME=recovery.sys.oxide.test
3152024-07-31T06:50:13.626Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3162024-07-31T06:50:13.756Z.+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.........+..+....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+..+...+....+...+.................+...+.+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-07-31T06:50:14.733Z.....+.......+...+.....+....+..............+....+.....+...+....+...+.....+.......+...+...........+......+..................+..........+........+....+...........+.......+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+......+........+...+........................+....+......+......+..+..........+......+.....+............+......................+...............+...+..+.............+...+..+...+.+.....+......+.........+....+.....+.........+............................+.........+...+...+.........+........+...+...+.+.....+......+....+...........+...................+...+.....+.............+..+.+......+...+..+..........+..................+........+...+............+...+.......+.....+.........+.........+.+.........+.....+.+...+.....+............+.+........+.+...........+......................+..+......+....+.........+..+....+........+......+.+.....+........................+....+...........+....+..+.............+...+..+.+...........+.........+........................+.+......+.........+...........+......+...............+.........+.+.....+....+.........+..+..........+.............................+.+...+.....+....+.....+......+....+..+.+...+.....+......+.+..+..........+.....+.......+...+................................+.+.....+...+.+...........+.......+..+...............+....+....................+....+.....+.+.....+......+....+......+......+..+...............+......+.+.....+...............+..........+........+..........+........+....+....................................+.....+...+.......+........+....+........+.............+......+......+..+...+....+...+.......................+.........+.............+........+............+...+.......+............+......+...+..+.........+.+..+.+......+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3182024-07-31T06:50:14.756Z-----
3192024-07-31T06:50:14.780Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3202024-07-31T06:50:14.780Za pkg/initial-tls-cert.pem 2K
3212024-07-31T06:50:14.780Za pkg/initial-tls-key.pem 4K
3222024-07-31T06:50:14.780Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3232024-07-31T06:50:14.780Z+ rmdir pkg
3242024-07-31T06:50:14.780Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3252024-07-31T06:50:14.780Z+ pfexec mkdir -p /usr/oxide
3262024-07-31T06:50:14.780Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3272024-07-31T06:50:15.473Z+ pfexec chmod +x /usr/oxide/oxide
3282024-07-31T06:50:15.497Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3292024-07-31T06:50:33.801Z+ OMICRON_NO_UNINSTALL=1
3302024-07-31T06:50:33.801Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3312024-07-31T06:50:33.825ZLogging to: /opt/oxide/work/out/LOG
3322024-07-31T06:50:34.345Z
3332024-07-31T06:50:34.369Zreal 0.539084220
3342024-07-31T06:50:34.369Zuser 0.116082608
3352024-07-31T06:50:34.369Zsys 2.216959816
3362024-07-31T06:50:34.369Ztrap 0.000000970
3372024-07-31T06:50:34.369Ztflt 0.000072859
3382024-07-31T06:50:34.369Zdflt 0.001191599
3392024-07-31T06:50:34.369Zkflt 0.000000000
3402024-07-31T06:50:34.369Zlock 48.893563151
3412024-07-31T06:50:34.369Zslp 0.752288147
3422024-07-31T06:50:34.369Zlat 0.003079129
3432024-07-31T06:50:34.369Zstop 0.221084191
3442024-07-31T06:50:34.369Z+ retry=0
3452024-07-31T06:50:34.369Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3462024-07-31T06:50:34.369Z+ [[ 0 -gt 30 ]]
3472024-07-31T06:50:34.369Z+ sleep 1
3482024-07-31T06:50:35.360Z+ retry=1
3492024-07-31T06:50:35.360Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3502024-07-31T06:50:35.384Z+ [[ 1 -gt 30 ]]
3512024-07-31T06:50:35.384Z+ sleep 1
3522024-07-31T06:50:36.375Z+ retry=2
3532024-07-31T06:50:36.375Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3542024-07-31T06:50:36.399Z+ [[ 2 -gt 30 ]]
3552024-07-31T06:50:36.399Z+ sleep 1
3562024-07-31T06:50:37.389Z+ retry=3
3572024-07-31T06:50:37.389Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3582024-07-31T06:50:55.904Z+ [[ 3 -gt 30 ]]
3592024-07-31T06:50:55.904Z+ sleep 1
3602024-07-31T06:50:56.907Z+ retry=4
3612024-07-31T06:50:56.907Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3622024-07-31T06:50:56.931Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3632024-07-31T06:50:56.955Zlocal v6:
3642024-07-31T06:50:56.955Zfe80::3c02:8bff:fed0:e196
3652024-07-31T06:50:56.955Zlocal v4:
3662024-07-31T06:50:56.955Z10.151.1.174
3672024-07-31T06:50:56.955Zrouter v6:
3682024-07-31T06:50:56.955Zrouter v4_idx:
3692024-07-31T06:50:56.955Zrouter v4_routes:
3702024-07-31T06:50:56.955Zresolver v4:
3712024-07-31T06:50:56.955Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3722024-07-31T06:50:56.955Zresolver v6:
3732024-07-31T06:50:56.955Zfe80::3c02:8bff:fed0:e196 -> 3e:02:8b:d0:e1:96
3742024-07-31T06:50:56.955Zfe80::9cce:28ff:fe33:9c67 -> 9e:ce:28:33:9c:67
3752024-07-31T06:50:56.955Znat v4:
3762024-07-31T06:50:56.955Znat_v6:
3772024-07-31T06:50:56.955Zport_mac:
3782024-07-31T06:50:56.955Z1: a8:40:25:21:bb:71
3792024-07-31T06:50:56.955Z1000: a8:40:25:21:bb:70
3802024-07-31T06:50:56.955Z2: a8:40:25:21:bb:91
3812024-07-31T06:50:56.955Zproxy arp:
3822024-07-31T06:50:56.955Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
3832024-07-31T06:50:56.955Z+ retry=0
3842024-07-31T06:50:56.955Z+++ zoneadm list -n
3852024-07-31T06:50:56.955Z+++ grep oxz_ntp
3862024-07-31T06:50:56.979Z++ pfexec svcs -z -Hostate oxide/ntp
3872024-07-31T06:50:56.979Zsvcs: zone '-Hostate': entity not found
3882024-07-31T06:50:56.979Z++ true
3892024-07-31T06:50:56.979Z+ [[ '' != online ]]
3902024-07-31T06:50:56.979Z+ [[ 0 -gt 60 ]]
3912024-07-31T06:50:56.979Z+ sleep 1
3922024-07-31T06:50:57.970Z+ retry=1
3932024-07-31T06:50:57.994Z+++ zoneadm list -n
3942024-07-31T06:50:57.994Z+++ grep oxz_ntp
3952024-07-31T06:50:57.994Z++ pfexec svcs -z -Hostate oxide/ntp
3962024-07-31T06:50:57.994Zsvcs: zone '-Hostate': entity not found
3972024-07-31T06:50:57.994Z++ true
3982024-07-31T06:50:57.994Z+ [[ '' != online ]]
3992024-07-31T06:50:57.994Z+ [[ 1 -gt 60 ]]
4002024-07-31T06:50:57.994Z+ sleep 1
4012024-07-31T06:50:58.995Z+ retry=2
4022024-07-31T06:50:59.019Z+++ zoneadm list -n
4032024-07-31T06:50:59.019Z+++ grep oxz_ntp
4042024-07-31T06:50:59.019Z++ pfexec svcs -z -Hostate oxide/ntp
4052024-07-31T06:50:59.019Zsvcs: zone '-Hostate': entity not found
4062024-07-31T06:50:59.019Z++ true
4072024-07-31T06:50:59.019Z+ [[ '' != online ]]
4082024-07-31T06:50:59.019Z+ [[ 2 -gt 60 ]]
4092024-07-31T06:50:59.019Z+ sleep 1
4102024-07-31T06:51:00.017Z+ retry=3
4112024-07-31T06:51:00.041Z+++ zoneadm list -n
4122024-07-31T06:51:00.041Z+++ grep oxz_ntp
4132024-07-31T06:51:00.041Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4142024-07-31T06:51:00.041Zsvcs: Could not bind to repository server for zone oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b: repository server unavailable
4152024-07-31T06:51:00.041Z++ true
4162024-07-31T06:51:00.042Z+ [[ '' != online ]]
4172024-07-31T06:51:00.042Z+ [[ 3 -gt 60 ]]
4182024-07-31T06:51:00.042Z+ sleep 1
4192024-07-31T06:51:01.044Z+ retry=4
4202024-07-31T06:51:01.068Z+++ zoneadm list -n
4212024-07-31T06:51:01.068Z+++ grep oxz_ntp
4222024-07-31T06:51:01.068Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4232024-07-31T06:51:01.092Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4242024-07-31T06:51:01.092Z++ true
4252024-07-31T06:51:01.092Z+ [[ '' != online ]]
4262024-07-31T06:51:01.092Z+ [[ 4 -gt 60 ]]
4272024-07-31T06:51:01.092Z+ sleep 1
4282024-07-31T06:51:02.073Z+ retry=5
4292024-07-31T06:51:02.097Z+++ zoneadm list -n
4302024-07-31T06:51:02.097Z+++ grep oxz_ntp
4312024-07-31T06:51:02.097Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4322024-07-31T06:51:02.121Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4332024-07-31T06:51:02.121Z++ true
4342024-07-31T06:51:02.121Z+ [[ '' != online ]]
4352024-07-31T06:51:02.121Z+ [[ 5 -gt 60 ]]
4362024-07-31T06:51:02.121Z+ sleep 1
4372024-07-31T06:51:03.105Z+ retry=6
4382024-07-31T06:51:03.129Z+++ zoneadm list -n
4392024-07-31T06:51:03.129Z+++ grep oxz_ntp
4402024-07-31T06:51:03.129Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4412024-07-31T06:51:03.153Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4422024-07-31T06:51:03.153Z++ true
4432024-07-31T06:51:03.153Z+ [[ '' != online ]]
4442024-07-31T06:51:03.153Z+ [[ 6 -gt 60 ]]
4452024-07-31T06:51:03.153Z+ sleep 1
4462024-07-31T06:51:04.135Z+ retry=7
4472024-07-31T06:51:04.159Z+++ zoneadm list -n
4482024-07-31T06:51:04.159Z+++ grep oxz_ntp
4492024-07-31T06:51:04.159Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4502024-07-31T06:51:04.183Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4512024-07-31T06:51:04.183Z++ true
4522024-07-31T06:51:04.183Z+ [[ '' != online ]]
4532024-07-31T06:51:04.183Z+ [[ 7 -gt 60 ]]
4542024-07-31T06:51:04.183Z+ sleep 1
4552024-07-31T06:51:05.164Z+ retry=8
4562024-07-31T06:51:05.188Z+++ zoneadm list -n
4572024-07-31T06:51:05.188Z+++ grep oxz_ntp
4582024-07-31T06:51:05.188Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4592024-07-31T06:51:05.188Z+ [[ offline != online ]]
4602024-07-31T06:51:05.188Z+ [[ 8 -gt 60 ]]
4612024-07-31T06:51:05.188Z+ sleep 1
4622024-07-31T06:51:06.187Z+ retry=9
4632024-07-31T06:51:06.210Z+++ zoneadm list -n
4642024-07-31T06:51:06.210Z+++ grep oxz_ntp
4652024-07-31T06:51:06.210Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4662024-07-31T06:51:06.210Z+ [[ offline != online ]]
4672024-07-31T06:51:06.210Z+ [[ 9 -gt 60 ]]
4682024-07-31T06:51:06.210Z+ sleep 1
4692024-07-31T06:51:07.209Z+ retry=10
4702024-07-31T06:51:07.234Z+++ zoneadm list -n
4712024-07-31T06:51:07.234Z+++ grep oxz_ntp
4722024-07-31T06:51:07.234Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4732024-07-31T06:51:07.234Z+ [[ offline != online ]]
4742024-07-31T06:51:07.234Z+ [[ 10 -gt 60 ]]
4752024-07-31T06:51:07.234Z+ sleep 1
4762024-07-31T06:51:08.233Z+ retry=11
4772024-07-31T06:51:08.256Z+++ zoneadm list -n
4782024-07-31T06:51:08.257Z+++ grep oxz_ntp
4792024-07-31T06:51:08.257Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4802024-07-31T06:51:08.257Z+ [[ offline != online ]]
4812024-07-31T06:51:08.257Z+ [[ 11 -gt 60 ]]
4822024-07-31T06:51:08.257Z+ sleep 1
4832024-07-31T06:51:09.254Z+ retry=12
4842024-07-31T06:51:09.278Z+++ zoneadm list -n
4852024-07-31T06:51:09.278Z+++ grep oxz_ntp
4862024-07-31T06:51:09.278Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4872024-07-31T06:51:09.278Z+ [[ offline != online ]]
4882024-07-31T06:51:09.278Z+ [[ 12 -gt 60 ]]
4892024-07-31T06:51:09.278Z+ sleep 1
4902024-07-31T06:51:10.277Z+ retry=13
4912024-07-31T06:51:10.301Z+++ zoneadm list -n
4922024-07-31T06:51:10.301Z+++ grep oxz_ntp
4932024-07-31T06:51:10.301Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
4942024-07-31T06:51:10.301Z+ [[ offline != online ]]
4952024-07-31T06:51:10.301Z+ [[ 13 -gt 60 ]]
4962024-07-31T06:51:10.301Z+ sleep 1
4972024-07-31T06:51:11.299Z+ retry=14
4982024-07-31T06:51:11.323Z+++ zoneadm list -n
4992024-07-31T06:51:11.323Z+++ grep oxz_ntp
5002024-07-31T06:51:11.323Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
5012024-07-31T06:51:11.323Z+ [[ offline != online ]]
5022024-07-31T06:51:11.323Z+ [[ 14 -gt 60 ]]
5032024-07-31T06:51:11.323Z+ sleep 1
5042024-07-31T06:51:12.320Z+ retry=15
5052024-07-31T06:51:12.344Z+++ zoneadm list -n
5062024-07-31T06:51:12.344Z+++ grep oxz_ntp
5072024-07-31T06:51:12.344Z++ pfexec svcs -z oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b -Hostate oxide/ntp
5082024-07-31T06:51:12.344Z+ [[ online != online ]]
5092024-07-31T06:51:12.344Z+ echo 'Waited for chrony: 15s'
5102024-07-31T06:51:12.344Z+ retry=0
5112024-07-31T06:51:12.344ZWaited for chrony: 15s
5122024-07-31T06:51:12.344Z+ zoneadm list
5132024-07-31T06:51:12.344Z+ grep nexus
5142024-07-31T06:51:12.368Z+ [[ 0 -gt 300 ]]
5152024-07-31T06:51:12.368Z+ sleep 1
 
5162024-07-31T06:51:12.432Zbuskin console login: Jul 31 06:51:12 buskin ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5172024-07-31T06:51:13.349Z+ retry=1
5182024-07-31T06:51:13.373Z+ zoneadm list
5192024-07-31T06:51:13.373Z+ grep nexus
5202024-07-31T06:51:13.373Z+ [[ 1 -gt 300 ]]
5212024-07-31T06:51:13.373Z+ sleep 1
5222024-07-31T06:51:14.360Z+ retry=2
5232024-07-31T06:51:14.383Z+ zoneadm list
5242024-07-31T06:51:14.384Z+ grep nexus
5252024-07-31T06:51:14.384Z+ [[ 2 -gt 300 ]]
5262024-07-31T06:51:14.384Z+ sleep 1
5272024-07-31T06:51:15.370Z+ retry=3
5282024-07-31T06:51:15.394Z+ zoneadm list
5292024-07-31T06:51:15.394Z+ grep nexus
5302024-07-31T06:51:15.394Z+ [[ 3 -gt 300 ]]
5312024-07-31T06:51:15.394Z+ sleep 1
5322024-07-31T06:51:16.381Z+ retry=4
5332024-07-31T06:51:16.404Z+ zoneadm list
5342024-07-31T06:51:16.404Z+ grep nexus
5352024-07-31T06:51:16.404Z+ [[ 4 -gt 300 ]]
5362024-07-31T06:51:16.404Z+ sleep 1
5372024-07-31T06:51:17.390Z+ retry=5
5382024-07-31T06:51:17.414Z+ zoneadm list
5392024-07-31T06:51:17.414Z+ grep nexus
5402024-07-31T06:51:17.414Z+ [[ 5 -gt 300 ]]
5412024-07-31T06:51:17.414Z+ sleep 1
5422024-07-31T06:51:18.401Z+ retry=6
5432024-07-31T06:51:18.425Z+ zoneadm list
5442024-07-31T06:51:18.425Z+ grep nexus
5452024-07-31T06:51:18.425Z+ [[ 6 -gt 300 ]]
5462024-07-31T06:51:18.425Z+ sleep 1
5472024-07-31T06:51:19.411Z+ retry=7
5482024-07-31T06:51:19.435Z+ zoneadm list
5492024-07-31T06:51:19.458Z+ grep nexus
5502024-07-31T06:51:19.459Z+ [[ 7 -gt 300 ]]
5512024-07-31T06:51:19.459Z+ sleep 1
5522024-07-31T06:51:20.421Z+ retry=8
5532024-07-31T06:51:20.445Z+ zoneadm list
5542024-07-31T06:51:20.445Z+ grep nexus
5552024-07-31T06:51:20.445Z+ [[ 8 -gt 300 ]]
5562024-07-31T06:51:20.445Z+ sleep 1
5572024-07-31T06:51:21.431Z+ retry=9
5582024-07-31T06:51:21.455Z+ zoneadm list
5592024-07-31T06:51:21.455Z+ grep nexus
5602024-07-31T06:51:21.455Z+ [[ 9 -gt 300 ]]
5612024-07-31T06:51:21.455Z+ sleep 1
5622024-07-31T06:51:22.442Z+ retry=10
5632024-07-31T06:51:22.466Z+ zoneadm list
5642024-07-31T06:51:22.466Z+ grep nexus
5652024-07-31T06:51:22.466Z+ [[ 10 -gt 300 ]]
5662024-07-31T06:51:22.466Z+ sleep 1
5672024-07-31T06:51:23.453Z+ retry=11
5682024-07-31T06:51:23.476Z+ zoneadm list
5692024-07-31T06:51:23.476Z+ grep nexus
5702024-07-31T06:51:23.476Z+ [[ 11 -gt 300 ]]
5712024-07-31T06:51:23.476Z+ sleep 1
5722024-07-31T06:51:24.463Z+ retry=12
5732024-07-31T06:51:24.486Z+ zoneadm list
5742024-07-31T06:51:24.486Z+ grep nexus
5752024-07-31T06:51:24.486Z+ [[ 12 -gt 300 ]]
5762024-07-31T06:51:24.486Z+ sleep 1
5772024-07-31T06:51:25.474Z+ retry=13
5782024-07-31T06:51:25.498Z+ zoneadm list
5792024-07-31T06:51:25.498Z+ grep nexus
5802024-07-31T06:51:25.498Z+ [[ 13 -gt 300 ]]
5812024-07-31T06:51:25.498Z+ sleep 1
5822024-07-31T06:51:26.484Z+ retry=14
5832024-07-31T06:51:26.508Z+ zoneadm list
5842024-07-31T06:51:26.508Z+ grep nexus
5852024-07-31T06:51:26.508Z+ [[ 14 -gt 300 ]]
5862024-07-31T06:51:26.508Z+ sleep 1
5872024-07-31T06:51:27.495Z+ retry=15
5882024-07-31T06:51:27.519Z+ zoneadm list
5892024-07-31T06:51:27.519Z+ grep nexus
5902024-07-31T06:51:27.519Z+ [[ 15 -gt 300 ]]
5912024-07-31T06:51:27.519Z+ sleep 1
5922024-07-31T06:51:28.506Z+ retry=16
5932024-07-31T06:51:28.530Z+ zoneadm list
5942024-07-31T06:51:28.530Z+ grep nexus
5952024-07-31T06:51:28.530Z+ [[ 16 -gt 300 ]]
5962024-07-31T06:51:28.530Z+ sleep 1
5972024-07-31T06:51:29.517Z+ retry=17
5982024-07-31T06:51:29.541Z+ zoneadm list
5992024-07-31T06:51:29.541Z+ grep nexus
6002024-07-31T06:51:29.541Z+ [[ 17 -gt 300 ]]
6012024-07-31T06:51:29.541Z+ sleep 1
6022024-07-31T06:51:30.529Z+ retry=18
6032024-07-31T06:51:30.552Z+ zoneadm list
6042024-07-31T06:51:30.553Z+ grep nexus
6052024-07-31T06:51:30.553Z+ [[ 18 -gt 300 ]]
6062024-07-31T06:51:30.553Z+ sleep 1
6072024-07-31T06:51:31.542Z+ retry=19
6082024-07-31T06:51:31.567Z+ zoneadm list
6092024-07-31T06:51:31.567Z+ grep nexus
6102024-07-31T06:51:31.567Z+ [[ 19 -gt 300 ]]
6112024-07-31T06:51:31.567Z+ sleep 1
6122024-07-31T06:51:32.573Z+ retry=20
6132024-07-31T06:51:32.597Z+ zoneadm list
6142024-07-31T06:51:32.597Z+ grep nexus
6152024-07-31T06:51:32.597Z+ [[ 20 -gt 300 ]]
6162024-07-31T06:51:32.597Z+ sleep 1
6172024-07-31T06:51:33.590Z+ retry=21
6182024-07-31T06:51:33.614Z+ zoneadm list
6192024-07-31T06:51:33.614Z+ grep nexus
6202024-07-31T06:51:33.614Z+ [[ 21 -gt 300 ]]
6212024-07-31T06:51:33.614Z+ sleep 1
6222024-07-31T06:51:34.609Z+ retry=22
6232024-07-31T06:51:34.632Z+ zoneadm list
6242024-07-31T06:51:34.632Z+ grep nexus
6252024-07-31T06:51:34.632Z+ [[ 22 -gt 300 ]]
6262024-07-31T06:51:34.632Z+ sleep 1
6272024-07-31T06:51:35.621Z+ retry=23
6282024-07-31T06:51:35.645Z+ zoneadm list
6292024-07-31T06:51:35.645Z+ grep nexus
6302024-07-31T06:51:35.645Z+ [[ 23 -gt 300 ]]
6312024-07-31T06:51:35.645Z+ sleep 1
6322024-07-31T06:51:36.632Z+ retry=24
6332024-07-31T06:51:36.656Z+ zoneadm list
6342024-07-31T06:51:36.656Z+ grep nexus
6352024-07-31T06:51:36.656Z+ [[ 24 -gt 300 ]]
6362024-07-31T06:51:36.656Z+ sleep 1
6372024-07-31T06:51:37.646Z+ retry=25
6382024-07-31T06:51:37.671Z+ zoneadm list
6392024-07-31T06:51:37.671Z+ grep nexus
6402024-07-31T06:51:37.671Z+ [[ 25 -gt 300 ]]
6412024-07-31T06:51:37.671Z+ sleep 1
6422024-07-31T06:51:38.657Z+ retry=26
6432024-07-31T06:51:38.681Z+ zoneadm list
6442024-07-31T06:51:38.681Z+ grep nexus
6452024-07-31T06:51:38.681Z+ [[ 26 -gt 300 ]]
6462024-07-31T06:51:38.681Z+ sleep 1
6472024-07-31T06:51:39.669Z+ retry=27
6482024-07-31T06:51:39.693Z+ zoneadm list
6492024-07-31T06:51:39.693Z+ grep nexus
6502024-07-31T06:51:39.693Z+ [[ 27 -gt 300 ]]
6512024-07-31T06:51:39.693Z+ sleep 1
6522024-07-31T06:51:40.681Z+ retry=28
6532024-07-31T06:51:40.704Z+ zoneadm list
6542024-07-31T06:51:40.705Z+ grep nexus
6552024-07-31T06:51:40.705Z+ [[ 28 -gt 300 ]]
6562024-07-31T06:51:40.705Z+ sleep 1
6572024-07-31T06:51:41.694Z+ retry=29
6582024-07-31T06:51:41.718Z+ zoneadm list
6592024-07-31T06:51:41.718Z+ grep nexus
6602024-07-31T06:51:41.718Z+ [[ 29 -gt 300 ]]
6612024-07-31T06:51:41.718Z+ sleep 1
6622024-07-31T06:51:42.706Z+ retry=30
6632024-07-31T06:51:42.730Z+ zoneadm list
6642024-07-31T06:51:42.730Z+ grep nexus
6652024-07-31T06:51:42.730Z+ [[ 30 -gt 300 ]]
6662024-07-31T06:51:42.730Z+ sleep 1
6672024-07-31T06:51:43.718Z+ retry=31
6682024-07-31T06:51:43.741Z+ zoneadm list
6692024-07-31T06:51:43.741Z+ grep nexus
6702024-07-31T06:51:43.742Z+ [[ 31 -gt 300 ]]
6712024-07-31T06:51:43.742Z+ sleep 1
6722024-07-31T06:51:44.730Z+ retry=32
6732024-07-31T06:51:44.754Z+ zoneadm list
6742024-07-31T06:51:44.754Z+ grep nexus
6752024-07-31T06:51:44.754Z+ [[ 32 -gt 300 ]]
6762024-07-31T06:51:44.754Z+ sleep 1
6772024-07-31T06:51:45.745Z+ retry=33
6782024-07-31T06:51:45.768Z+ zoneadm list
6792024-07-31T06:51:45.768Z+ grep nexus
6802024-07-31T06:51:45.769Z+ [[ 33 -gt 300 ]]
6812024-07-31T06:51:45.769Z+ sleep 1
6822024-07-31T06:51:46.787Z+ retry=34
6832024-07-31T06:51:46.787Z+ zoneadm list
6842024-07-31T06:51:46.812Z+ grep nexus
6852024-07-31T06:51:46.812Z+ [[ 34 -gt 300 ]]
6862024-07-31T06:51:46.812Z+ sleep 1
6872024-07-31T06:51:47.805Z+ retry=35
6882024-07-31T06:51:47.828Z+ zoneadm list
6892024-07-31T06:51:47.828Z+ grep nexus
6902024-07-31T06:51:47.828Z+ [[ 35 -gt 300 ]]
6912024-07-31T06:51:47.829Z+ sleep 1
6922024-07-31T06:51:48.820Z+ retry=36
6932024-07-31T06:51:48.844Z+ zoneadm list
6942024-07-31T06:51:48.844Z+ grep nexus
6952024-07-31T06:51:48.844Z+ [[ 36 -gt 300 ]]
6962024-07-31T06:51:48.844Z+ sleep 1
6972024-07-31T06:51:49.832Z+ retry=37
6982024-07-31T06:51:49.856Z+ zoneadm list
6992024-07-31T06:51:49.856Z+ grep nexus
7002024-07-31T06:51:49.856Z+ [[ 37 -gt 300 ]]
7012024-07-31T06:51:49.856Z+ sleep 1
7022024-07-31T06:51:50.844Z+ retry=38
7032024-07-31T06:51:50.868Z+ zoneadm list
7042024-07-31T06:51:50.868Z+ grep nexus
7052024-07-31T06:51:50.868Z+ [[ 38 -gt 300 ]]
7062024-07-31T06:51:50.868Z+ sleep 1
7072024-07-31T06:51:51.856Z+ retry=39
7082024-07-31T06:51:51.880Z+ zoneadm list
7092024-07-31T06:51:51.880Z+ grep nexus
7102024-07-31T06:51:51.880Z+ [[ 39 -gt 300 ]]
7112024-07-31T06:51:51.880Z+ sleep 1
7122024-07-31T06:51:52.869Z+ retry=40
7132024-07-31T06:51:52.893Z+ zoneadm list
7142024-07-31T06:51:52.893Z+ grep nexus
7152024-07-31T06:51:52.893Z+ [[ 40 -gt 300 ]]
7162024-07-31T06:51:52.893Z+ sleep 1
7172024-07-31T06:51:53.882Z+ retry=41
7182024-07-31T06:51:53.906Z+ zoneadm list
7192024-07-31T06:51:53.906Z+ grep nexus
7202024-07-31T06:51:53.906Z+ [[ 41 -gt 300 ]]
7212024-07-31T06:51:53.906Z+ sleep 1
7222024-07-31T06:51:54.894Z+ retry=42
7232024-07-31T06:51:54.918Z+ zoneadm list
7242024-07-31T06:51:54.918Z+ grep nexus
7252024-07-31T06:51:54.918Z+ [[ 42 -gt 300 ]]
7262024-07-31T06:51:54.918Z+ sleep 1
7272024-07-31T06:51:55.906Z+ retry=43
7282024-07-31T06:51:55.930Z+ zoneadm list
7292024-07-31T06:51:55.930Z+ grep nexus
7302024-07-31T06:51:55.930Z+ [[ 43 -gt 300 ]]
7312024-07-31T06:51:55.930Z+ sleep 1
7322024-07-31T06:51:56.917Z+ retry=44
7332024-07-31T06:51:56.941Z+ zoneadm list
7342024-07-31T06:51:56.941Z+ grep nexus
7352024-07-31T06:51:56.941Z+ [[ 44 -gt 300 ]]
7362024-07-31T06:51:56.941Z+ sleep 1
7372024-07-31T06:51:57.931Z+ retry=45
7382024-07-31T06:51:57.955Z+ zoneadm list
7392024-07-31T06:51:57.955Z+ grep nexus
7402024-07-31T06:51:57.955Z+ [[ 45 -gt 300 ]]
7412024-07-31T06:51:57.955Z+ sleep 1
7422024-07-31T06:51:58.945Z+ retry=46
7432024-07-31T06:51:58.969Z+ zoneadm list
7442024-07-31T06:51:58.969Z+ grep nexus
7452024-07-31T06:51:58.969Z+ [[ 46 -gt 300 ]]
7462024-07-31T06:51:58.969Z+ sleep 1
7472024-07-31T06:51:59.957Z+ retry=47
7482024-07-31T06:51:59.981Z+ zoneadm list
7492024-07-31T06:51:59.981Z+ grep nexus
7502024-07-31T06:51:59.981Z+ [[ 47 -gt 300 ]]
7512024-07-31T06:51:59.981Z+ sleep 1
7522024-07-31T06:52:00.971Z+ retry=48
7532024-07-31T06:52:00.995Z+ zoneadm list
7542024-07-31T06:52:00.995Z+ grep nexus
7552024-07-31T06:52:00.995Z+ [[ 48 -gt 300 ]]
7562024-07-31T06:52:00.995Z+ sleep 1
7572024-07-31T06:52:01.984Z+ retry=49
7582024-07-31T06:52:02.008Z+ zoneadm list
7592024-07-31T06:52:02.008Z+ grep nexus
7602024-07-31T06:52:02.008Z+ [[ 49 -gt 300 ]]
7612024-07-31T06:52:02.008Z+ sleep 1
7622024-07-31T06:52:02.997Z+ retry=50
7632024-07-31T06:52:03.020Z+ zoneadm list
7642024-07-31T06:52:03.020Z+ grep nexus
7652024-07-31T06:52:03.020Z+ [[ 50 -gt 300 ]]
7662024-07-31T06:52:03.020Z+ sleep 1
7672024-07-31T06:52:04.008Z+ retry=51
7682024-07-31T06:52:04.032Z+ zoneadm list
7692024-07-31T06:52:04.032Z+ grep nexus
7702024-07-31T06:52:04.032Z+ [[ 51 -gt 300 ]]
7712024-07-31T06:52:04.032Z+ sleep 1
7722024-07-31T06:52:05.021Z+ retry=52
7732024-07-31T06:52:05.045Z+ zoneadm list
7742024-07-31T06:52:05.045Z+ grep nexus
7752024-07-31T06:52:05.045Z+ [[ 52 -gt 300 ]]
7762024-07-31T06:52:05.045Z+ sleep 1
7772024-07-31T06:52:06.049Z+ retry=53
7782024-07-31T06:52:06.073Z+ zoneadm list
7792024-07-31T06:52:07.329Z+ grep nexus
7802024-07-31T06:52:08.320Z+ [[ 53 -gt 300 ]]
7812024-07-31T06:52:08.343Z+ sleep 1
7822024-07-31T06:52:09.442Z+ retry=54
7832024-07-31T06:52:09.468Z+ zoneadm list
7842024-07-31T06:52:09.468Z+ grep nexus
7852024-07-31T06:52:09.508Z+ [[ 54 -gt 300 ]]
7862024-07-31T06:52:09.508Z+ sleep 1
7872024-07-31T06:52:11.381Z+ retry=55
7882024-07-31T06:52:11.406Z+ zoneadm list
7892024-07-31T06:52:11.406Z+ grep nexus
7902024-07-31T06:52:11.455Z+ [[ 55 -gt 300 ]]
7912024-07-31T06:52:11.479Z+ sleep 1
7922024-07-31T06:52:12.768Z+ retry=56
7932024-07-31T06:52:12.885Z+ zoneadm list
7942024-07-31T06:52:12.910Z+ grep nexus
7952024-07-31T06:52:13.047Z+ [[ 56 -gt 300 ]]
7962024-07-31T06:52:13.071Z+ sleep 1
7972024-07-31T06:52:14.126Z+ retry=57
7982024-07-31T06:52:14.156Z+ zoneadm list
7992024-07-31T06:52:14.156Z+ grep nexus
8002024-07-31T06:52:14.180Z+ [[ 57 -gt 300 ]]
8012024-07-31T06:52:14.180Z+ sleep 1
8022024-07-31T06:52:15.168Z+ retry=58
8032024-07-31T06:52:15.192Z+ zoneadm list
8042024-07-31T06:52:15.192Z+ grep nexus
8052024-07-31T06:52:15.192Z+ [[ 58 -gt 300 ]]
8062024-07-31T06:52:15.192Z+ sleep 1
8072024-07-31T06:52:16.194Z+ retry=59
8082024-07-31T06:52:16.218Z+ zoneadm list
8092024-07-31T06:52:16.218Z+ grep nexus
8102024-07-31T06:52:16.218Z+ [[ 59 -gt 300 ]]
8112024-07-31T06:52:16.218Z+ sleep 1
8122024-07-31T06:52:17.219Z+ retry=60
8132024-07-31T06:52:17.247Z+ zoneadm list
8142024-07-31T06:52:17.247Z+ grep nexus
8152024-07-31T06:52:17.247Zoxz_nexus_40617403-4bc0-415b-a44f-ba1e978d04f1
8162024-07-31T06:52:17.247Zoxz_nexus_9c0b2ead-66ba-40c3-8ca0-cf6949ba475d
8172024-07-31T06:52:17.247Z+ echo 'Waited for nexus: 60s'
8182024-07-31T06:52:17.247ZWaited for nexus: 60s
8192024-07-31T06:52:17.247Z+ export RUST_BACKTRACE=1
8202024-07-31T06:52:17.247Z+ RUST_BACKTRACE=1
8212024-07-31T06:52:17.247Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8222024-07-31T06:52:17.247Z++ ./target/debug/bootstrap
8232024-07-31T06:52:17.971ZUsing external DNS server at 10.151.1.164:53
8242024-07-31T06:52:17.995Z2024-07-31 06:52:17.982607867 UTC: attempting to log into API
8252024-07-31T06:52:33.052Z2024-07-31 06:52:33.040818271 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8262024-07-31T06:52:34.054Z2024-07-31 06:52:34.044036693 UTC: attempting to log into API
 
8272024-07-31T06:52:34.373ZJul 31 06:52:33 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:216.31.17.12:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
8282024-07-31T06:52:42.073ZJul 31 06:52:37 buskin last message repeated 1 time
8292024-07-31T06:52:42.121ZJul 31 06:52:41 buskin ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
8302024-07-31T06:52:42.154ZJul 31 06:52:41 buskin ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
8312024-07-31T06:52:42.188ZJul 31 06:52:41 buskin ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
8322024-07-31T06:52:42.517ZJul 31 06:52:41 buskin ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
8332024-07-31T06:52:42.553ZJul 31 06:52:41 buskin ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
 
8342024-07-31T06:52:49.105Z2024-07-31 06:52:49.094877013 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8352024-07-31T06:52:50.105Z2024-07-31 06:52:50.095163022 UTC: attempting to log into API
8362024-07-31T06:53:05.137Z2024-07-31 06:53:05.127303388 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8372024-07-31T06:53:06.139Z2024-07-31 06:53:06.128504409 UTC: attempting to log into API
8382024-07-31T06:53:21.172Z2024-07-31 06:53:21.160806818 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8392024-07-31T06:53:22.172Z2024-07-31 06:53:22.162060129 UTC: attempting to log into API
8402024-07-31T06:53:22.941Z2024-07-31 06:53:22.930988639 UTC: login succeeded
8412024-07-31T06:53:22.973Zwaiting for nexus to come up...
8422024-07-31T06:53:23.041Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8432024-07-31T06:53:23.229Zsetting up quotas...
8442024-07-31T06:53:23.276Zensuring datasets are ready...
8452024-07-31T06:53:25.846Zlet's roll.
8462024-07-31T06:53:25.870Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8472024-07-31T06:53:25.870ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8482024-07-31T06:53:25.870ZOXIDE_TOKEN=oxide-token-92e12f00b2adadc00d5529a439aa9e4e341faf6c'
8492024-07-31T06:53:25.870Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8502024-07-31T06:53:25.870Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8512024-07-31T06:53:25.870Z++ OXIDE_TOKEN=oxide-token-92e12f00b2adadc00d5529a439aa9e4e341faf6c
8522024-07-31T06:53:25.870Z+ export OXIDE_HOST OXIDE_TOKEN
8532024-07-31T06:53:25.870Z+ retry=0
8542024-07-31T06:53:25.870Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8552024-07-31T06:53:25.941Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
8562024-07-31T06:53:26.439Z{"status":"ok"}success
8572024-07-31T06:53:26.439ZProject {
8582024-07-31T06:53:26.439Z description: "some images",
8592024-07-31T06:53:26.439Z id: 87be688b-ad7d-46d7-89f4-cc053a727556,
8602024-07-31T06:53:26.439Z name: Name(
8612024-07-31T06:53:26.439Z "images",
8622024-07-31T06:53:26.439Z ),
8632024-07-31T06:53:26.463Z time_created: 2024-07-31T06:53:26.029413Z,
8642024-07-31T06:53:26.463Z time_modified: 2024-07-31T06:53:26.029413Z,
8652024-07-31T06:53:26.463Z}
8662024-07-31T06:53:26.463Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
8672024-07-31T06:55:19.861ZJul 31 06:55:19 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:216.31.17.12:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8682024-07-31T06:58:35.829Zdone!
8692024-07-31T06:58:35.928Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
8702024-07-31T06:58:36.039Zsuccess
8712024-07-31T06:58:36.039ZImage {
8722024-07-31T06:58:36.039Z block_size: ByteCount(
8732024-07-31T06:58:36.039Z 512,
8742024-07-31T06:58:36.039Z ),
8752024-07-31T06:58:36.063Z description: "debian 11 original base image",
8762024-07-31T06:58:36.063Z digest: None,
8772024-07-31T06:58:36.063Z id: 7f1bcbcf-7121-4c00-b358-3e21027d869e,
8782024-07-31T06:58:36.063Z name: Name(
8792024-07-31T06:58:36.063Z "debian11",
8802024-07-31T06:58:36.063Z ),
8812024-07-31T06:58:36.063Z os: "debian",
8822024-07-31T06:58:36.063Z project_id: None,
8832024-07-31T06:58:36.063Z size: ByteCount(
8842024-07-31T06:58:36.063Z 2147483648,
8852024-07-31T06:58:36.063Z ),
8862024-07-31T06:58:36.063Z time_created: 2024-07-31T06:58:35.771468Z,
8872024-07-31T06:58:36.063Z time_modified: 2024-07-31T06:58:36.021895Z,
8882024-07-31T06:58:36.063Z url: None,
8892024-07-31T06:58:36.063Z version: "11",
8902024-07-31T06:58:36.063Z}
8912024-07-31T06:58:36.063Z+ for test_bin in tests/*
8922024-07-31T06:58:36.063Z+ ./tests/bootstrap-468fdec28d591750
8932024-07-31T06:58:36.087Z
8942024-07-31T06:58:36.087Zrunning 0 tests
8952024-07-31T06:58:36.087Z
8962024-07-31T06:58:36.087Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8972024-07-31T06:58:36.087Z
8982024-07-31T06:58:36.087Z+ for test_bin in tests/*
8992024-07-31T06:58:36.087Z+ ./tests/commtest-514666b6015de861
9002024-07-31T06:58:36.117Z
9012024-07-31T06:58:36.117Zrunning 0 tests
9022024-07-31T06:58:36.141Z
9032024-07-31T06:58:36.141Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9042024-07-31T06:58:36.141Z
9052024-07-31T06:58:36.141Z+ for test_bin in tests/*
9062024-07-31T06:58:36.141Z+ ./tests/dhcp_server-69cc2fc5d974a558
9072024-07-31T06:58:36.165Z
9082024-07-31T06:58:36.165Zrunning 0 tests
9092024-07-31T06:58:36.165Z
9102024-07-31T06:58:36.165Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9112024-07-31T06:58:36.165Z
9122024-07-31T06:58:36.165Z+ for test_bin in tests/*
9132024-07-31T06:58:36.165Z+ ./tests/end_to_end_tests-0133cc9faedf70dd
9142024-07-31T06:58:36.504Z
9152024-07-31T06:58:36.504Zrunning 2 tests
9162024-07-31T06:58:36.805Ztest no_spoof::no_spoof_here ... ok
9172024-07-31T06:59:09.252Ztest instance_launch::instance_launch ... ok
9182024-07-31T06:59:09.252Z
9192024-07-31T06:59:09.276Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 32.75s
9202024-07-31T06:59:09.276Z
9212024-07-31T06:59:09.276Z+ _exit_trap
9222024-07-31T06:59:09.276Z+ local status=0
9232024-07-31T06:59:09.276Z+ set +o errexit
9242024-07-31T06:59:09.276Z+ pfexec svcadm -Z disable -s cron
9252024-07-31T06:59:11.403Z+ [[ 0 -eq 0 ]]
9262024-07-31T06:59:11.403Z+ exit 0
9272024-07-31T06:59:11.426Zprocess exited: duration 561640 ms, exit code 0
 
9282024-07-31T06:59:11.531Zfound 107 output files
9292024-07-31T06:59:11.531Zuploading: /var/svc/log/oxide-sled-agent:default.log (984210 bytes)
9302024-07-31T06:59:12.830Zuploaded: /var/svc/log/oxide-sled-agent:default.log
9312024-07-31T06:59:12.831Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (4252264 bytes)
9322024-07-31T06:59:13.232Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 4252264 -> 4265769
9332024-07-31T06:59:14.301Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
9342024-07-31T06:59:14.301Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (33198 bytes)
9352024-07-31T06:59:15.458Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
9362024-07-31T06:59:15.458Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (167391 bytes)
9372024-07-31T06:59:15.641Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 167391 -> 168953
9382024-07-31T06:59:16.712Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
9392024-07-31T06:59:16.712Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (211541 bytes)
9402024-07-31T06:59:16.917Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 211541 -> 213881
9412024-07-31T06:59:17.988Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
9422024-07-31T06:59:17.988Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1296594 bytes)
9432024-07-31T06:59:18.359Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1296594 -> 1319559
9442024-07-31T06:59:19.444Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
9452024-07-31T06:59:19.444Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (689816 bytes)
9462024-07-31T06:59:19.684Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 689816 -> 702566
9472024-07-31T06:59:20.755Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
9482024-07-31T06:59:20.755Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (3382 bytes)
9492024-07-31T06:59:21.851Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
9502024-07-31T06:59:21.851Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (248226 bytes)
9512024-07-31T06:59:22.057Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 248226 -> 252883
9522024-07-31T06:59:23.129Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
9532024-07-31T06:59:23.129Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (7684 bytes)
9542024-07-31T06:59:23.199Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 7684 -> 8269
9552024-07-31T06:59:24.271Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
9562024-07-31T06:59:24.271Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3977 bytes)
9572024-07-31T06:59:25.367Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
9582024-07-31T06:59:25.367Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (7501 bytes)
9592024-07-31T06:59:26.484Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
9602024-07-31T06:59:26.484Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_cockroachdb_cc47d604-1a56-46a3-b1d6-8a45d591c364/root/var/svc/log/oxide-cockroach-admin:default.log (4659 bytes)
9612024-07-31T06:59:27.580Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_cockroachdb_cc47d604-1a56-46a3-b1d6-8a45d591c364/root/var/svc/log/oxide-cockroach-admin:default.log
9622024-07-31T06:59:27.580Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_cockroachdb_cc47d604-1a56-46a3-b1d6-8a45d591c364/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
9632024-07-31T06:59:28.676Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_cockroachdb_cc47d604-1a56-46a3-b1d6-8a45d591c364/root/var/svc/log/oxide-cockroachdb:default.log
9642024-07-31T06:59:28.676Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_cockroachdb_cc47d604-1a56-46a3-b1d6-8a45d591c364/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
9652024-07-31T06:59:29.771Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_cockroachdb_cc47d604-1a56-46a3-b1d6-8a45d591c364/root/var/svc/log/oxide-zone-network-setup:default.log
9662024-07-31T06:59:29.771Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-crucible-agent:default.log (23880 bytes)
9672024-07-31T06:59:30.910Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-crucible-agent:default.log
9682024-07-31T06:59:30.910Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9692024-07-31T06:59:32.006Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-crucible-downstairs:default.log
9702024-07-31T06:59:32.006Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-crucible-downstairs:downstairs-4661be90-d2aa-4e72-a2fb-173ce4f62c04.log (3124 bytes)
9712024-07-31T06:59:33.102Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-crucible-downstairs:downstairs-4661be90-d2aa-4e72-a2fb-173ce4f62c04.log
9722024-07-31T06:59:33.102Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-crucible-downstairs:downstairs-b8272e63-4fec-45e3-842a-86e231312125.log (5994 bytes)
9732024-07-31T06:59:34.198Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-crucible-downstairs:downstairs-b8272e63-4fec-45e3-842a-86e231312125.log
9742024-07-31T06:59:34.199Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
9752024-07-31T06:59:35.294Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_crucible_081c67a9-c5d6-4b92-ba92-6245bb87e821/root/var/svc/log/oxide-zone-network-setup:default.log
9762024-07-31T06:59:35.294Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_external_dns_e9a9e648-4d72-4d2f-a8cb-bf9d3a13b06e/root/var/svc/log/oxide-external_dns:default.log (26902 bytes)
9772024-07-31T06:59:36.434Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_external_dns_e9a9e648-4d72-4d2f-a8cb-bf9d3a13b06e/root/var/svc/log/oxide-external_dns:default.log
9782024-07-31T06:59:36.434Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_external_dns_e9a9e648-4d72-4d2f-a8cb-bf9d3a13b06e/root/var/svc/log/oxide-opte-interface-setup:default.log (1154 bytes)
9792024-07-31T06:59:37.530Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_external_dns_e9a9e648-4d72-4d2f-a8cb-bf9d3a13b06e/root/var/svc/log/oxide-opte-interface-setup:default.log
9802024-07-31T06:59:37.530Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_external_dns_e9a9e648-4d72-4d2f-a8cb-bf9d3a13b06e/root/var/svc/log/oxide-zone-network-setup:default.log (1695 bytes)
9812024-07-31T06:59:38.625Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_external_dns_e9a9e648-4d72-4d2f-a8cb-bf9d3a13b06e/root/var/svc/log/oxide-zone-network-setup:default.log
9822024-07-31T06:59:38.625Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_internal_dns_c9f2d876-9daf-4455-9e70-593059870159/root/var/svc/log/oxide-internal_dns:default.log (107813 bytes)
9832024-07-31T06:59:39.833Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_internal_dns_c9f2d876-9daf-4455-9e70-593059870159/root/var/svc/log/oxide-internal_dns:default.log
9842024-07-31T06:59:39.833Zuploading: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_internal_dns_c9f2d876-9daf-4455-9e70-593059870159/root/var/svc/log/oxide-zone-network-setup:default.log (1678 bytes)
9852024-07-31T06:59:40.928Zuploaded: /pool/ext/06f736a1-3bc3-4997-b039-30d48b1f8fe2/crypt/zone/oxz_internal_dns_c9f2d876-9daf-4455-9e70-593059870159/root/var/svc/log/oxide-zone-network-setup:default.log
9862024-07-31T06:59:40.928Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_cockroachdb_31f6794b-957a-4d98-a78e-e8e5b5174106/root/var/svc/log/oxide-cockroach-admin:default.log (3722 bytes)
9872024-07-31T06:59:42.025Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_cockroachdb_31f6794b-957a-4d98-a78e-e8e5b5174106/root/var/svc/log/oxide-cockroach-admin:default.log
9882024-07-31T06:59:42.025Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_cockroachdb_31f6794b-957a-4d98-a78e-e8e5b5174106/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
9892024-07-31T06:59:43.120Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_cockroachdb_31f6794b-957a-4d98-a78e-e8e5b5174106/root/var/svc/log/oxide-cockroachdb:default.log
9902024-07-31T06:59:43.120Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_cockroachdb_31f6794b-957a-4d98-a78e-e8e5b5174106/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
9912024-07-31T06:59:44.216Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_cockroachdb_31f6794b-957a-4d98-a78e-e8e5b5174106/root/var/svc/log/oxide-zone-network-setup:default.log
9922024-07-31T06:59:44.216Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_68e398a4-8f90-4dd3-a024-75e2b2bf9b7b/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
9932024-07-31T06:59:45.312Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_68e398a4-8f90-4dd3-a024-75e2b2bf9b7b/root/var/svc/log/oxide-crucible-agent:default.log
9942024-07-31T06:59:45.312Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_68e398a4-8f90-4dd3-a024-75e2b2bf9b7b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9952024-07-31T06:59:46.407Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_68e398a4-8f90-4dd3-a024-75e2b2bf9b7b/root/var/svc/log/oxide-crucible-downstairs:default.log
9962024-07-31T06:59:46.407Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_68e398a4-8f90-4dd3-a024-75e2b2bf9b7b/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
9972024-07-31T06:59:47.503Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_68e398a4-8f90-4dd3-a024-75e2b2bf9b7b/root/var/svc/log/oxide-zone-network-setup:default.log
9982024-07-31T06:59:47.503Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_pantry_21076e3c-bc2a-4171-8512-85427bf4507f/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
9992024-07-31T06:59:48.598Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_pantry_21076e3c-bc2a-4171-8512-85427bf4507f/root/var/svc/log/oxide-crucible-pantry:default.log
10002024-07-31T06:59:48.598Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_pantry_21076e3c-bc2a-4171-8512-85427bf4507f/root/var/svc/log/oxide-zone-network-setup:default.log (1715 bytes)
10012024-07-31T06:59:49.694Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_crucible_pantry_21076e3c-bc2a-4171-8512-85427bf4507f/root/var/svc/log/oxide-zone-network-setup:default.log
10022024-07-31T06:59:49.694Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_oximeter_0ca21f21-eb39-4a9d-8e14-c592076e002c/root/var/svc/log/oxide-oximeter:default.log (1573526 bytes)
10032024-07-31T06:59:50.054Zupload warning: file "/pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_oximeter_0ca21f21-eb39-4a9d-8e14-c592076e002c/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1573526 -> 1719679
10042024-07-31T06:59:51.126Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_oximeter_0ca21f21-eb39-4a9d-8e14-c592076e002c/root/var/svc/log/oxide-oximeter:default.log
10052024-07-31T06:59:51.126Zuploading: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_oximeter_0ca21f21-eb39-4a9d-8e14-c592076e002c/root/var/svc/log/oxide-zone-network-setup:default.log (1668 bytes)
10062024-07-31T06:59:52.222Zuploaded: /pool/ext/24e34f86-83a9-43db-80ec-ed851650b6f0/crypt/zone/oxz_oximeter_0ca21f21-eb39-4a9d-8e14-c592076e002c/root/var/svc/log/oxide-zone-network-setup:default.log
10072024-07-31T06:59:52.246Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-agent:default.log (26457 bytes)
10082024-07-31T06:59:53.363Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-agent:default.log
10092024-07-31T06:59:53.363Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10102024-07-31T06:59:54.459Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-downstairs:default.log
10112024-07-31T06:59:54.459Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-downstairs:downstairs-7ad347ac-a7b3-4c2e-974e-57faac3876b8.log (6078 bytes)
10122024-07-31T06:59:55.550Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-downstairs:downstairs-7ad347ac-a7b3-4c2e-974e-57faac3876b8.log
10132024-07-31T06:59:55.550Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-downstairs:downstairs-a18ecff2-19d2-4511-9c17-6a137e747753.log (3125 bytes)
10142024-07-31T06:59:56.642Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-downstairs:downstairs-a18ecff2-19d2-4511-9c17-6a137e747753.log
10152024-07-31T06:59:56.642Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-downstairs:snapshot-7ad347ac-a7b3-4c2e-974e-57faac3876b8-66282e51-1b54-4615-a46d-430ecdd87e5a.log (5684 bytes)
10162024-07-31T06:59:57.734Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-crucible-downstairs:snapshot-7ad347ac-a7b3-4c2e-974e-57faac3876b8-66282e51-1b54-4615-a46d-430ecdd87e5a.log
10172024-07-31T06:59:57.734Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-zone-network-setup:default.log (1671 bytes)
10182024-07-31T06:59:58.826Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_crucible_66082be1-4fd2-4d41-8c86-a50edc81687c/root/var/svc/log/oxide-zone-network-setup:default.log
10192024-07-31T06:59:58.826Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/svc/log/oxide-chrony-setup:default.log (14162 bytes)
10202024-07-31T06:59:59.940Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/svc/log/oxide-chrony-setup:default.log
10212024-07-31T06:59:59.940Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/svc/log/oxide-ntp:default.log (1347 bytes)
10222024-07-31T07:00:01.032Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/svc/log/oxide-ntp:default.log
10232024-07-31T07:00:01.032Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
10242024-07-31T07:00:02.124Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/svc/log/oxide-opte-interface-setup:default.log
10252024-07-31T07:00:02.125Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/svc/log/oxide-zone-network-setup:default.log (1632 bytes)
10262024-07-31T07:00:03.217Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/svc/log/oxide-zone-network-setup:default.log
10272024-07-31T07:00:03.217Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_clickhouse_4697bb27-7e32-4165-a7eb-90bab94417ae/root/var/svc/log/oxide-clickhouse:default.log (2699333 bytes)
10282024-07-31T07:00:03.571Zupload warning: file "/pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_clickhouse_4697bb27-7e32-4165-a7eb-90bab94417ae/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2699333 -> 3014081
10292024-07-31T07:00:04.640Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_clickhouse_4697bb27-7e32-4165-a7eb-90bab94417ae/root/var/svc/log/oxide-clickhouse:default.log
10302024-07-31T07:00:04.640Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_clickhouse_4697bb27-7e32-4165-a7eb-90bab94417ae/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
10312024-07-31T07:00:05.732Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_clickhouse_4697bb27-7e32-4165-a7eb-90bab94417ae/root/var/svc/log/oxide-zone-network-setup:default.log
10322024-07-31T07:00:05.733Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_cockroachdb_17acee8e-25e6-4490-8bd5-dec3caecc935/root/var/svc/log/oxide-cockroach-admin:default.log (2795 bytes)
10332024-07-31T07:00:06.825Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_cockroachdb_17acee8e-25e6-4490-8bd5-dec3caecc935/root/var/svc/log/oxide-cockroach-admin:default.log
10342024-07-31T07:00:06.825Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_cockroachdb_17acee8e-25e6-4490-8bd5-dec3caecc935/root/var/svc/log/oxide-cockroachdb:default.log (4288 bytes)
10352024-07-31T07:00:07.918Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_cockroachdb_17acee8e-25e6-4490-8bd5-dec3caecc935/root/var/svc/log/oxide-cockroachdb:default.log
10362024-07-31T07:00:07.918Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_cockroachdb_17acee8e-25e6-4490-8bd5-dec3caecc935/root/var/svc/log/oxide-zone-network-setup:default.log (1678 bytes)
10372024-07-31T07:00:09.010Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_cockroachdb_17acee8e-25e6-4490-8bd5-dec3caecc935/root/var/svc/log/oxide-zone-network-setup:default.log
10382024-07-31T07:00:09.010Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_crucible_de3f2933-cfb1-421e-8251-9e483a0f2a9d/root/var/svc/log/oxide-crucible-agent:default.log (8484 bytes)
10392024-07-31T07:00:10.124Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_crucible_de3f2933-cfb1-421e-8251-9e483a0f2a9d/root/var/svc/log/oxide-crucible-agent:default.log
10402024-07-31T07:00:10.125Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_crucible_de3f2933-cfb1-421e-8251-9e483a0f2a9d/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10412024-07-31T07:00:11.217Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_crucible_de3f2933-cfb1-421e-8251-9e483a0f2a9d/root/var/svc/log/oxide-crucible-downstairs:default.log
10422024-07-31T07:00:11.217Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_crucible_de3f2933-cfb1-421e-8251-9e483a0f2a9d/root/var/svc/log/oxide-crucible-downstairs:downstairs-be22cb83-14e1-445f-b470-745b7c1fcfed.log (3020 bytes)
10432024-07-31T07:00:12.308Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_crucible_de3f2933-cfb1-421e-8251-9e483a0f2a9d/root/var/svc/log/oxide-crucible-downstairs:downstairs-be22cb83-14e1-445f-b470-745b7c1fcfed.log
10442024-07-31T07:00:12.309Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_crucible_de3f2933-cfb1-421e-8251-9e483a0f2a9d/root/var/svc/log/oxide-zone-network-setup:default.log (1671 bytes)
10452024-07-31T07:00:13.401Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_crucible_de3f2933-cfb1-421e-8251-9e483a0f2a9d/root/var/svc/log/oxide-zone-network-setup:default.log
10462024-07-31T07:00:13.401Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_external_dns_6d55ed2f-f2b8-43c1-9b7c-3db069a6d309/root/var/svc/log/oxide-external_dns:default.log (26906 bytes)
10472024-07-31T07:00:13.511Zupload warning: file "/pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_external_dns_6d55ed2f-f2b8-43c1-9b7c-3db069a6d309/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26906 -> 30682
10482024-07-31T07:00:14.580Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_external_dns_6d55ed2f-f2b8-43c1-9b7c-3db069a6d309/root/var/svc/log/oxide-external_dns:default.log
10492024-07-31T07:00:14.580Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_external_dns_6d55ed2f-f2b8-43c1-9b7c-3db069a6d309/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
10502024-07-31T07:00:15.672Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_external_dns_6d55ed2f-f2b8-43c1-9b7c-3db069a6d309/root/var/svc/log/oxide-opte-interface-setup:default.log
10512024-07-31T07:00:15.672Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_external_dns_6d55ed2f-f2b8-43c1-9b7c-3db069a6d309/root/var/svc/log/oxide-zone-network-setup:default.log (1695 bytes)
10522024-07-31T07:00:16.765Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_external_dns_6d55ed2f-f2b8-43c1-9b7c-3db069a6d309/root/var/svc/log/oxide-zone-network-setup:default.log
10532024-07-31T07:00:16.765Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_internal_dns_a7076e9d-878b-4da9-8917-1474b8810063/root/var/svc/log/oxide-internal_dns:default.log (108616 bytes)
10542024-07-31T07:00:16.919Zupload warning: file "/pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_internal_dns_a7076e9d-878b-4da9-8917-1474b8810063/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 108616 -> 112373
10552024-07-31T07:00:17.988Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_internal_dns_a7076e9d-878b-4da9-8917-1474b8810063/root/var/svc/log/oxide-internal_dns:default.log
10562024-07-31T07:00:17.988Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_internal_dns_a7076e9d-878b-4da9-8917-1474b8810063/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
10572024-07-31T07:00:19.081Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_internal_dns_a7076e9d-878b-4da9-8917-1474b8810063/root/var/svc/log/oxide-zone-network-setup:default.log
10582024-07-31T07:00:19.081Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_nexus_1340fef4-8dc1-4b28-b8b0-1e487542e513/root/var/svc/log/oxide-nexus:default.log (38735711 bytes)
10592024-07-31T07:00:20.654Zupload warning: file "/pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_nexus_1340fef4-8dc1-4b28-b8b0-1e487542e513/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 38735711 -> 39256050
10602024-07-31T07:00:21.723Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_nexus_1340fef4-8dc1-4b28-b8b0-1e487542e513/root/var/svc/log/oxide-nexus:default.log
10612024-07-31T07:00:21.723Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_nexus_1340fef4-8dc1-4b28-b8b0-1e487542e513/root/var/svc/log/oxide-opte-interface-setup:default.log (1134 bytes)
10622024-07-31T07:00:22.815Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_nexus_1340fef4-8dc1-4b28-b8b0-1e487542e513/root/var/svc/log/oxide-opte-interface-setup:default.log
10632024-07-31T07:00:22.815Zuploading: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_nexus_1340fef4-8dc1-4b28-b8b0-1e487542e513/root/var/svc/log/oxide-zone-network-setup:default.log (1652 bytes)
10642024-07-31T07:00:23.907Zuploaded: /pool/ext/5f14c655-0c06-4acb-9f3c-b00fb6d7b055/crypt/zone/oxz_nexus_1340fef4-8dc1-4b28-b8b0-1e487542e513/root/var/svc/log/oxide-zone-network-setup:default.log
10652024-07-31T07:00:23.907Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_cockroachdb_95ecd501-d18f-4660-8fb6-823ab0d62c2e/root/var/svc/log/oxide-cockroach-admin:default.log (3726 bytes)
10662024-07-31T07:00:24.999Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_cockroachdb_95ecd501-d18f-4660-8fb6-823ab0d62c2e/root/var/svc/log/oxide-cockroach-admin:default.log
10672024-07-31T07:00:24.999Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_cockroachdb_95ecd501-d18f-4660-8fb6-823ab0d62c2e/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
10682024-07-31T07:00:26.092Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_cockroachdb_95ecd501-d18f-4660-8fb6-823ab0d62c2e/root/var/svc/log/oxide-cockroachdb:default.log
10692024-07-31T07:00:26.092Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_cockroachdb_95ecd501-d18f-4660-8fb6-823ab0d62c2e/root/var/svc/log/oxide-zone-network-setup:default.log (1679 bytes)
10702024-07-31T07:00:27.184Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_cockroachdb_95ecd501-d18f-4660-8fb6-823ab0d62c2e/root/var/svc/log/oxide-zone-network-setup:default.log
10712024-07-31T07:00:27.184Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_crucible_d57c246b-9504-4d84-bd6c-1fa575ca2f5d/root/var/svc/log/oxide-crucible-agent:default.log (8056 bytes)
10722024-07-31T07:00:28.299Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_crucible_d57c246b-9504-4d84-bd6c-1fa575ca2f5d/root/var/svc/log/oxide-crucible-agent:default.log
10732024-07-31T07:00:28.299Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_crucible_d57c246b-9504-4d84-bd6c-1fa575ca2f5d/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10742024-07-31T07:00:29.391Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_crucible_d57c246b-9504-4d84-bd6c-1fa575ca2f5d/root/var/svc/log/oxide-crucible-downstairs:default.log
10752024-07-31T07:00:29.391Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_crucible_d57c246b-9504-4d84-bd6c-1fa575ca2f5d/root/var/svc/log/oxide-crucible-downstairs:downstairs-81193695-2af6-4279-93d3-ebbcc5f7627a.log (3020 bytes)
10762024-07-31T07:00:30.486Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_crucible_d57c246b-9504-4d84-bd6c-1fa575ca2f5d/root/var/svc/log/oxide-crucible-downstairs:downstairs-81193695-2af6-4279-93d3-ebbcc5f7627a.log
10772024-07-31T07:00:30.486Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_crucible_d57c246b-9504-4d84-bd6c-1fa575ca2f5d/root/var/svc/log/oxide-zone-network-setup:default.log (1672 bytes)
10782024-07-31T07:00:31.578Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_crucible_d57c246b-9504-4d84-bd6c-1fa575ca2f5d/root/var/svc/log/oxide-zone-network-setup:default.log
10792024-07-31T07:00:31.578Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_internal_dns_b0d02819-892e-44a3-ad1e-8e39069ac3a4/root/var/svc/log/oxide-internal_dns:default.log (108211 bytes)
10802024-07-31T07:00:31.733Zupload warning: file "/pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_internal_dns_b0d02819-892e-44a3-ad1e-8e39069ac3a4/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 108211 -> 111965
10812024-07-31T07:00:32.802Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_internal_dns_b0d02819-892e-44a3-ad1e-8e39069ac3a4/root/var/svc/log/oxide-internal_dns:default.log
10822024-07-31T07:00:32.802Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_internal_dns_b0d02819-892e-44a3-ad1e-8e39069ac3a4/root/var/svc/log/oxide-zone-network-setup:default.log (1678 bytes)
10832024-07-31T07:00:33.894Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_internal_dns_b0d02819-892e-44a3-ad1e-8e39069ac3a4/root/var/svc/log/oxide-zone-network-setup:default.log
10842024-07-31T07:00:33.894Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_nexus_40617403-4bc0-415b-a44f-ba1e978d04f1/root/var/svc/log/oxide-nexus:default.log (2585874 bytes)
10852024-07-31T07:00:34.246Zupload warning: file "/pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_nexus_40617403-4bc0-415b-a44f-ba1e978d04f1/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2585874 -> 2990959
10862024-07-31T07:00:35.315Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_nexus_40617403-4bc0-415b-a44f-ba1e978d04f1/root/var/svc/log/oxide-nexus:default.log
10872024-07-31T07:00:35.315Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_nexus_40617403-4bc0-415b-a44f-ba1e978d04f1/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
10882024-07-31T07:00:36.407Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_nexus_40617403-4bc0-415b-a44f-ba1e978d04f1/root/var/svc/log/oxide-opte-interface-setup:default.log
10892024-07-31T07:00:36.407Zuploading: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_nexus_40617403-4bc0-415b-a44f-ba1e978d04f1/root/var/svc/log/oxide-zone-network-setup:default.log (1653 bytes)
10902024-07-31T07:00:37.499Zuploaded: /pool/ext/a5df5876-d5c1-479f-839e-cc45c5c76ac8/crypt/zone/oxz_nexus_40617403-4bc0-415b-a44f-ba1e978d04f1/root/var/svc/log/oxide-zone-network-setup:default.log
10912024-07-31T07:00:37.499Zuploading: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-agent:default.log (34994 bytes)
10922024-07-31T07:00:38.656Zuploaded: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-agent:default.log
10932024-07-31T07:00:38.656Zuploading: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10942024-07-31T07:00:39.748Zuploaded: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-downstairs:default.log
10952024-07-31T07:00:39.748Zuploading: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-downstairs:downstairs-78ba7c59-9cef-45d1-9bbf-10106f52d1f3.log (6075 bytes)
10962024-07-31T07:00:40.840Zuploaded: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-downstairs:downstairs-78ba7c59-9cef-45d1-9bbf-10106f52d1f3.log
10972024-07-31T07:00:40.840Zuploading: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-downstairs:downstairs-aea1caeb-09e1-4303-999d-236862fac15d.log (5993 bytes)
10982024-07-31T07:00:41.932Zuploaded: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-downstairs:downstairs-aea1caeb-09e1-4303-999d-236862fac15d.log
10992024-07-31T07:00:41.932Zuploading: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-downstairs:snapshot-78ba7c59-9cef-45d1-9bbf-10106f52d1f3-66282e51-1b54-4615-a46d-430ecdd87e5a.log (5684 bytes)
11002024-07-31T07:00:43.025Zuploaded: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-crucible-downstairs:snapshot-78ba7c59-9cef-45d1-9bbf-10106f52d1f3-66282e51-1b54-4615-a46d-430ecdd87e5a.log
11012024-07-31T07:00:43.025Zuploading: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-zone-network-setup:default.log (1672 bytes)
11022024-07-31T07:00:44.118Zuploaded: /pool/ext/b206718d-e839-412f-b7fa-c4d3648098d7/crypt/zone/oxz_crucible_46dd73cd-3a0a-4ab3-8c1d-c35556e76bf8/root/var/svc/log/oxide-zone-network-setup:default.log
11032024-07-31T07:00:44.118Zuploading: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-crucible-agent:default.log (18408 bytes)
11042024-07-31T07:00:45.254Zuploaded: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-crucible-agent:default.log
11052024-07-31T07:00:45.255Zuploading: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11062024-07-31T07:00:46.347Zuploaded: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-crucible-downstairs:default.log
11072024-07-31T07:00:46.347Zuploading: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-45425fc2-77d9-4eec-a417-dbc2daf39351.log (6076 bytes)
11082024-07-31T07:00:47.439Zuploaded: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-45425fc2-77d9-4eec-a417-dbc2daf39351.log
11092024-07-31T07:00:47.439Zuploading: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-crucible-downstairs:snapshot-45425fc2-77d9-4eec-a417-dbc2daf39351-66282e51-1b54-4615-a46d-430ecdd87e5a.log (5684 bytes)
11102024-07-31T07:00:48.532Zuploaded: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-crucible-downstairs:snapshot-45425fc2-77d9-4eec-a417-dbc2daf39351-66282e51-1b54-4615-a46d-430ecdd87e5a.log
11112024-07-31T07:00:48.532Zuploading: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-zone-network-setup:default.log (1671 bytes)
11122024-07-31T07:00:49.624Zuploaded: /pool/ext/b5858a03-073d-4bb1-b734-c31dcd7693e1/crypt/zone/oxz_crucible_ee9d318c-0d59-41c7-a44d-ade0a3b275fb/root/var/svc/log/oxide-zone-network-setup:default.log
11132024-07-31T07:00:49.624Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_cockroachdb_43cda2a1-82b1-467b-995b-041b902cf8cb/root/var/svc/log/oxide-cockroach-admin:default.log (4659 bytes)
11142024-07-31T07:00:50.715Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_cockroachdb_43cda2a1-82b1-467b-995b-041b902cf8cb/root/var/svc/log/oxide-cockroach-admin:default.log
11152024-07-31T07:00:50.715Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_cockroachdb_43cda2a1-82b1-467b-995b-041b902cf8cb/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
11162024-07-31T07:00:51.808Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_cockroachdb_43cda2a1-82b1-467b-995b-041b902cf8cb/root/var/svc/log/oxide-cockroachdb:default.log
11172024-07-31T07:00:51.808Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_cockroachdb_43cda2a1-82b1-467b-995b-041b902cf8cb/root/var/svc/log/oxide-zone-network-setup:default.log (1678 bytes)
11182024-07-31T07:00:52.900Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_cockroachdb_43cda2a1-82b1-467b-995b-041b902cf8cb/root/var/svc/log/oxide-zone-network-setup:default.log
11192024-07-31T07:00:52.900Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-crucible-agent:default.log (23450 bytes)
11202024-07-31T07:00:54.038Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-crucible-agent:default.log
11212024-07-31T07:00:54.038Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11222024-07-31T07:00:55.131Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-crucible-downstairs:default.log
11232024-07-31T07:00:55.131Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-crucible-downstairs:downstairs-c75eab5d-df73-489e-bff9-ec63a6e10b5a.log (3126 bytes)
11242024-07-31T07:00:56.223Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-crucible-downstairs:downstairs-c75eab5d-df73-489e-bff9-ec63a6e10b5a.log
11252024-07-31T07:00:56.223Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-crucible-downstairs:downstairs-d4c39fb2-d9b8-4e16-8b0b-78188be3ee7e.log (5991 bytes)
11262024-07-31T07:00:57.315Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-crucible-downstairs:downstairs-d4c39fb2-d9b8-4e16-8b0b-78188be3ee7e.log
11272024-07-31T07:00:57.315Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
11282024-07-31T07:00:58.407Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_49ca3494-f279-4fe7-b913-596ab0682b38/root/var/svc/log/oxide-zone-network-setup:default.log
11292024-07-31T07:00:58.407Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_pantry_32192e93-da92-4660-bf17-d48f1da7fcce/root/var/svc/log/oxide-crucible-pantry:default.log (779 bytes)
11302024-07-31T07:00:59.498Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_pantry_32192e93-da92-4660-bf17-d48f1da7fcce/root/var/svc/log/oxide-crucible-pantry:default.log
11312024-07-31T07:00:59.499Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_pantry_32192e93-da92-4660-bf17-d48f1da7fcce/root/var/svc/log/oxide-zone-network-setup:default.log (1712 bytes)
11322024-07-31T07:01:00.590Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_crucible_pantry_32192e93-da92-4660-bf17-d48f1da7fcce/root/var/svc/log/oxide-zone-network-setup:default.log
11332024-07-31T07:01:00.591Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_nexus_9c0b2ead-66ba-40c3-8ca0-cf6949ba475d/root/var/svc/log/oxide-nexus:default.log (2584738 bytes)
11342024-07-31T07:01:00.944Zupload warning: file "/pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_nexus_9c0b2ead-66ba-40c3-8ca0-cf6949ba475d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2584738 -> 3175798
11352024-07-31T07:01:02.015Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_nexus_9c0b2ead-66ba-40c3-8ca0-cf6949ba475d/root/var/svc/log/oxide-nexus:default.log
11362024-07-31T07:01:02.015Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_nexus_9c0b2ead-66ba-40c3-8ca0-cf6949ba475d/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11372024-07-31T07:01:03.107Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_nexus_9c0b2ead-66ba-40c3-8ca0-cf6949ba475d/root/var/svc/log/oxide-opte-interface-setup:default.log
11382024-07-31T07:01:03.107Zuploading: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_nexus_9c0b2ead-66ba-40c3-8ca0-cf6949ba475d/root/var/svc/log/oxide-zone-network-setup:default.log (1651 bytes)
11392024-07-31T07:01:04.199Zuploaded: /pool/ext/e528cce2-69bf-42b7-9ee1-694580ece316/crypt/zone/oxz_nexus_9c0b2ead-66ba-40c3-8ca0-cf6949ba475d/root/var/svc/log/oxide-zone-network-setup:default.log
11402024-07-31T07:01:04.199Zuploading: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_adc778d6-1b44-48c1-89a1-18c1d8da53e2/root/var/svc/log/oxide-crucible-agent:default.log (8484 bytes)
11412024-07-31T07:01:05.312Zuploaded: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_adc778d6-1b44-48c1-89a1-18c1d8da53e2/root/var/svc/log/oxide-crucible-agent:default.log
11422024-07-31T07:01:05.312Zuploading: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_adc778d6-1b44-48c1-89a1-18c1d8da53e2/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11432024-07-31T07:01:06.404Zuploaded: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_adc778d6-1b44-48c1-89a1-18c1d8da53e2/root/var/svc/log/oxide-crucible-downstairs:default.log
11442024-07-31T07:01:06.404Zuploading: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_adc778d6-1b44-48c1-89a1-18c1d8da53e2/root/var/svc/log/oxide-crucible-downstairs:downstairs-74df0642-381e-4a04-af51-79038d845174.log (3017 bytes)
11452024-07-31T07:01:07.497Zuploaded: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_adc778d6-1b44-48c1-89a1-18c1d8da53e2/root/var/svc/log/oxide-crucible-downstairs:downstairs-74df0642-381e-4a04-af51-79038d845174.log
11462024-07-31T07:01:07.497Zuploading: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_adc778d6-1b44-48c1-89a1-18c1d8da53e2/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
11472024-07-31T07:01:08.589Zuploaded: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_adc778d6-1b44-48c1-89a1-18c1d8da53e2/root/var/svc/log/oxide-zone-network-setup:default.log
11482024-07-31T07:01:08.589Zuploading: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_pantry_19606ecd-4c2b-4950-8957-050fb0d6c379/root/var/svc/log/oxide-crucible-pantry:default.log (765694 bytes)
11492024-07-31T07:01:09.904Zuploaded: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_pantry_19606ecd-4c2b-4950-8957-050fb0d6c379/root/var/svc/log/oxide-crucible-pantry:default.log
11502024-07-31T07:01:09.904Zuploading: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_pantry_19606ecd-4c2b-4950-8957-050fb0d6c379/root/var/svc/log/oxide-zone-network-setup:default.log (1715 bytes)
11512024-07-31T07:01:10.996Zuploaded: /pool/ext/f65b8cd2-8612-4fdd-97c0-fea65309a509/crypt/zone/oxz_crucible_pantry_19606ecd-4c2b-4950-8957-050fb0d6c379/root/var/svc/log/oxide-zone-network-setup:default.log
11522024-07-31T07:01:10.996Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/measurements.log (133575 bytes)
11532024-07-31T07:01:11.173Zupload warning: file "/pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/measurements.log" changed size mid upload: 133575 -> 166181
11542024-07-31T07:01:12.242Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/measurements.log
11552024-07-31T07:01:12.242Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/statistics.log (90090 bytes)
11562024-07-31T07:01:12.396Zupload warning: file "/pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/statistics.log" changed size mid upload: 90090 -> 116181
11572024-07-31T07:01:13.465Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/statistics.log
11582024-07-31T07:01:13.466Zuploading: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/tracking.log (16638 bytes)
11592024-07-31T07:01:13.555Zupload warning: file "/pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/tracking.log" changed size mid upload: 16638 -> 19014
11602024-07-31T07:01:14.623Zuploaded: /pool/ext/384f913d-8e83-4644-8bbe-b289954f5941/crypt/zone/oxz_ntp_4596e5f1-85c3-421f-97f4-b55f541cc20b/root/var/log/chrony/tracking.log