01JBJ5476X1B089XQKA7MXN8W0: test-repair

BasicConfig {
    output_rules: [
        "%/tmp/*.txt",
        "%/tmp/debug/*",
        "/tmp/core.*",
    ],
    rust_toolchain: None,
    target: Some(
        "helios-2.0",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01JBJ54Q8MWY6K2A16VEW6YPY1

Artefacts:

Output:

SEQ	GLOBAL TIME	DETAILS
1	2024-10-31T20:59:15.380Z	job dependencies complete; ready to run (waiting for 14 m 59 s)
2	2024-10-31T21:00:16.452Z	job assigned to worker 01JBJ60HQJPRWN8XY4C1QDEXQW (queued for 1 m 1 s)
3	2024-10-31T21:00:24.622Z	downloading input: /input/build/work/bins/crucible-downstairs.gz
4	2024-10-31T21:00:25.737Z	downloaded input: /input/build/work/bins/crucible-downstairs.gz
5	2024-10-31T21:00:25.737Z	downloading input: /input/build/work/bins/crucible-hammer.gz
6	2024-10-31T21:00:26.819Z	downloaded input: /input/build/work/bins/crucible-hammer.gz
7	2024-10-31T21:00:26.819Z	downloading input: /input/build/work/bins/crutest.gz
8	2024-10-31T21:00:27.966Z	downloaded input: /input/build/work/bins/crutest.gz
9	2024-10-31T21:00:27.966Z	downloading input: /input/build/work/bins/dsc.gz
10	2024-10-31T21:00:28.707Z	downloaded input: /input/build/work/bins/dsc.gz
11	2024-10-31T21:00:28.712Z	downloading input: /input/build/work/scripts/perf-downstairs-tick.d
12	2024-10-31T21:00:28.728Z	downloaded input: /input/build/work/scripts/perf-downstairs-tick.d
13	2024-10-31T21:00:28.729Z	downloading input: /input/build/work/scripts/test_ds.sh
14	2024-10-31T21:00:28.755Z	downloaded input: /input/build/work/scripts/test_ds.sh
15	2024-10-31T21:00:28.755Z	downloading input: /input/build/work/scripts/test_live_repair.sh
16	2024-10-31T21:00:28.790Z	downloaded input: /input/build/work/scripts/test_live_repair.sh
17	2024-10-31T21:00:28.790Z	downloading input: /input/build/work/scripts/test_repair.sh
18	2024-10-31T21:00:28.846Z	downloaded input: /input/build/work/scripts/test_repair.sh
19	2024-10-31T21:00:28.849Z	downloading input: /input/build/work/scripts/test_replay.sh
20	2024-10-31T21:00:28.909Z	downloaded input: /input/build/work/scripts/test_replay.sh
21	2024-10-31T21:00:28.909Z	downloading input: /input/build/work/scripts/test_up.sh
22	2024-10-31T21:00:28.927Z	downloaded input: /input/build/work/scripts/test_up.sh
23	2024-10-31T21:00:28.927Z	downloading input: /input/build/work/scripts/upstairs_info.d
24	2024-10-31T21:00:28.963Z	downloaded input: /input/build/work/scripts/upstairs_info.d
25	2024-10-31T21:00:28.966Z	downloading input: /input/build/tmp/cargo-test-out.log
26	2024-10-31T21:00:29.750Z	downloaded input: /input/build/tmp/cargo-test-out.log

27	2024-10-31T21:00:29.750Z	starting task 0: "setup"
28	2024-10-31T21:00:29.761Z	++ uname -s
29	2024-10-31T21:00:29.761Z	+ kern=SunOS
30	2024-10-31T21:00:29.761Z	+ case "$kern" in
31	2024-10-31T21:00:29.762Z	+ [[ 0 == 12345 ]]
32	2024-10-31T21:00:29.762Z	+ groupadd -g 12345 build
33	2024-10-31T21:00:29.762Z	+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
34	2024-10-31T21:00:31.769Z	+ zfs create -o mountpoint=/work rpool/work
35	2024-10-31T21:00:32.063Z	++ awk '$2 == "/home" { print $3 }' /etc/mnttab
36	2024-10-31T21:00:32.067Z	+ home_fs=zfs
37	2024-10-31T21:00:32.068Z	+ [[ zfs == autofs ]]
38	2024-10-31T21:00:32.068Z	+ mkdir -p /home/build
39	2024-10-31T21:00:32.071Z	+ chown build:build /home/build /work
40	2024-10-31T21:00:34.070Z	+ chmod 0700 /home/build /work
41	2024-10-31T21:00:34.075Z	process exited: duration 4331 ms, exit code 0

42	2024-10-31T21:00:34.081Z	starting task 1: "authentication"
43	2024-10-31T21:00:34.098Z	process exited: duration 16 ms, exit code 0

44	2024-10-31T21:00:34.103Z	starting task 2: "build"
45	2024-10-31T21:00:34.108Z	+ banner cores
46	2024-10-31T21:00:34.127Z
47	2024-10-31T21:00:34.127Z	#### #### ##### ###### ####
48	2024-10-31T21:00:34.127Z	# # # # # # # #
49	2024-10-31T21:00:34.127Z	# # # # # ##### ####
50	2024-10-31T21:00:34.127Z	# # # ##### # #
51	2024-10-31T21:00:34.127Z	# # # # # # # # #
52	2024-10-31T21:00:34.127Z	#### #### # # ###### ####
53	2024-10-31T21:00:34.127Z
54	2024-10-31T21:00:34.130Z	+ pfexec coreadm -i /tmp/core.%f.%p -g /tmp/core.%f.%p -e global -e log -e proc-setid -e global-setid
55	2024-10-31T21:00:34.138Z	+ echo 'input bins dir contains:'
56	2024-10-31T21:00:34.138Z	input bins dir contains:
57	2024-10-31T21:00:34.143Z	+ ls -ltr /input/build/work/bins
58	2024-10-31T21:00:34.143Z	total 771752
59	2024-10-31T21:00:34.143Z	-rw-r--r-- 1 root root 110753512 Oct 31 21:00 crucible-downstairs.gz
60	2024-10-31T21:00:34.143Z	-rw-r--r-- 1 root root 105892009 Oct 31 21:00 crucible-hammer.gz
61	2024-10-31T21:00:34.143Z	-rw-r--r-- 1 root root 111418362 Oct 31 21:00 crutest.gz
62	2024-10-31T21:00:34.143Z	-rw-r--r-- 1 root root 66803931 Oct 31 21:00 dsc.gz
63	2024-10-31T21:00:34.143Z	+ echo 'input script dir contains:'
64	2024-10-31T21:00:34.143Z	+ ls -ltr /input/build/work/scripts
65	2024-10-31T21:00:34.143Z	input script dir contains:
66	2024-10-31T21:00:34.149Z	total 42
67	2024-10-31T21:00:34.149Z	-rw-r--r-- 1 root root 3056 Oct 31 21:00 perf-downstairs-tick.d
68	2024-10-31T21:00:34.149Z	-rw-r--r-- 1 root root 2127 Oct 31 21:00 test_ds.sh
69	2024-10-31T21:00:34.149Z	-rw-r--r-- 1 root root 4272 Oct 31 21:00 test_live_repair.sh
70	2024-10-31T21:00:34.149Z	-rw-r--r-- 1 root root 6724 Oct 31 21:00 test_repair.sh
71	2024-10-31T21:00:34.149Z	-rw-r--r-- 1 root root 3494 Oct 31 21:00 test_replay.sh
72	2024-10-31T21:00:34.149Z	-rw-r--r-- 1 root root 13887 Oct 31 21:00 test_up.sh
73	2024-10-31T21:00:34.149Z	-rw-r--r-- 1 root root 2407 Oct 31 21:00 upstairs_info.d
74	2024-10-31T21:00:34.149Z	+ pfexec chmod +x /input/build/work/scripts/perf-downstairs-tick.d /input/build/work/scripts/test_ds.sh /input/build/work/scripts/test_live_repair.sh /input/build/work/scripts/test_repair.sh /input/build/work/scripts/test_replay.sh /input/build/work/scripts/test_up.sh /input/build/work/scripts/upstairs_info.d
75	2024-10-31T21:00:34.150Z	+ echo ' chmod input script dir contains:'
76	2024-10-31T21:00:34.150Z	chmod input script dir contains:
77	2024-10-31T21:00:34.150Z	+ ls -ltr /input/build/work/scripts
78	2024-10-31T21:00:34.155Z	total 42
79	2024-10-31T21:00:34.155Z	-rwxr-xr-x 1 root root 3056 Oct 31 21:00 perf-downstairs-tick.d
80	2024-10-31T21:00:34.155Z	-rwxr-xr-x 1 root root 2127 Oct 31 21:00 test_ds.sh
81	2024-10-31T21:00:34.155Z	-rwxr-xr-x 1 root root 4272 Oct 31 21:00 test_live_repair.sh
82	2024-10-31T21:00:34.155Z	-rwxr-xr-x 1 root root 6724 Oct 31 21:00 test_repair.sh
83	2024-10-31T21:00:34.155Z	-rwxr-xr-x 1 root root 3494 Oct 31 21:00 test_replay.sh
84	2024-10-31T21:00:34.155Z	-rwxr-xr-x 1 root root 13887 Oct 31 21:00 test_up.sh
85	2024-10-31T21:00:34.155Z	-rwxr-xr-x 1 root root 2407 Oct 31 21:00 upstairs_info.d
86	2024-10-31T21:00:34.155Z	+ banner unpack
87	2024-10-31T21:00:34.155Z
88	2024-10-31T21:00:34.155Z	# # # # ##### ## #### # #
89	2024-10-31T21:00:34.155Z	# # ## # # # # # # # # #
90	2024-10-31T21:00:34.155Z	# # # # # # # # # # ####
91	2024-10-31T21:00:34.155Z	# # # # # ##### ###### # # #
92	2024-10-31T21:00:34.155Z	# # # ## # # # # # # #
93	2024-10-31T21:00:34.155Z	#### # # # # # #### # #
94	2024-10-31T21:00:34.155Z
95	2024-10-31T21:00:34.155Z	+ mkdir -p /var/tmp/bins
96	2024-10-31T21:00:34.155Z	+ for t in "$input/bins/"*.gz
97	2024-10-31T21:00:34.159Z	++ basename /input/build/work/bins/crucible-downstairs.gz
98	2024-10-31T21:00:34.159Z	+ b=crucible-downstairs.gz
99	2024-10-31T21:00:34.159Z	+ b=crucible-downstairs
100	2024-10-31T21:00:34.159Z	+ gunzip
101	2024-10-31T21:00:36.465Z	+ chmod +x /var/tmp/bins/crucible-downstairs
102	2024-10-31T21:00:36.467Z	+ for t in "$input/bins/"*.gz
103	2024-10-31T21:00:36.470Z	++ basename /input/build/work/bins/crucible-hammer.gz
104	2024-10-31T21:00:36.470Z	+ b=crucible-hammer.gz
105	2024-10-31T21:00:36.470Z	+ b=crucible-hammer
106	2024-10-31T21:00:36.470Z	+ gunzip
107	2024-10-31T21:00:38.678Z	+ chmod +x /var/tmp/bins/crucible-hammer
108	2024-10-31T21:00:38.681Z	+ for t in "$input/bins/"*.gz
109	2024-10-31T21:00:38.683Z	++ basename /input/build/work/bins/crutest.gz
110	2024-10-31T21:00:38.683Z	+ b=crutest.gz
111	2024-10-31T21:00:38.683Z	+ b=crutest
112	2024-10-31T21:00:38.683Z	+ gunzip
113	2024-10-31T21:00:41.062Z	+ chmod +x /var/tmp/bins/crutest
114	2024-10-31T21:00:41.065Z	+ for t in "$input/bins/"*.gz
115	2024-10-31T21:00:41.066Z	++ basename /input/build/work/bins/dsc.gz
116	2024-10-31T21:00:41.068Z	+ b=dsc.gz
117	2024-10-31T21:00:41.068Z	+ b=dsc
118	2024-10-31T21:00:41.068Z	+ gunzip
119	2024-10-31T21:00:42.435Z	+ chmod +x /var/tmp/bins/dsc
120	2024-10-31T21:00:42.438Z	+ export BINDIR=/var/tmp/bins
121	2024-10-31T21:00:42.438Z	+ BINDIR=/var/tmp/bins
122	2024-10-31T21:00:42.438Z	+ echo 'Setup self timeout'
123	2024-10-31T21:00:42.438Z	Setup self timeout
124	2024-10-31T21:00:42.438Z	+ jobpid=1137
125	2024-10-31T21:00:42.438Z	+ echo 'Setup debug logging'
126	2024-10-31T21:00:42.439Z	Setup debug logging
127	2024-10-31T21:00:42.439Z	+ mkdir /tmp/debug
128	2024-10-31T21:00:42.442Z	+ sleep 7200
129	2024-10-31T21:00:42.442Z	+ psrinfo -v
130	2024-10-31T21:00:42.446Z	+ df -h
131	2024-10-31T21:00:42.470Z	+ prstat -d d -mLc 1
132	2024-10-31T21:00:42.473Z	+ iostat -T d -xn 1
133	2024-10-31T21:00:42.473Z	+ mpstat -T d 1
134	2024-10-31T21:00:42.473Z	+ vmstat -T d -p 1
135	2024-10-31T21:00:42.473Z	+ pfexec dtrace -Z -s /input/build/work/scripts/perf-downstairs-tick.d
136	2024-10-31T21:00:42.476Z	+ banner repair
137	2024-10-31T21:00:42.476Z	+ pfexec dtrace -Z -s /input/build/work/scripts/upstairs_info.d
138	2024-10-31T21:00:42.476Z
139	2024-10-31T21:00:42.476Z	##### ###### ##### ## # #####
140	2024-10-31T21:00:42.476Z	# # # # # # # # # #
141	2024-10-31T21:00:42.476Z	# # ##### # # # # # # #
142	2024-10-31T21:00:42.476Z	##### # ##### ###### # #####
143	2024-10-31T21:00:42.476Z	# # # # # # # # #
144	2024-10-31T21:00:42.477Z	# # ###### # # # # # #
145	2024-10-31T21:00:42.477Z
146	2024-10-31T21:00:42.477Z	+ ptime -m bash /input/build/work/scripts/test_repair.sh -N
147	2024-10-31T21:08:08.400Z	+ echo 'Test repair finished with 0'
148	2024-10-31T21:08:08.400Z	Test repair finished with 0
149	2024-10-31T21:08:13.406Z	process exited: duration 454233 ms, exit code 0
150	2024-10-31T21:08:13.406Z	exec warning: : stdio descriptors remain open after task exit; waiting 60 seconds for them to close
151	2024-10-31T21:09:13.458Z	exec warning: : stdout descriptor may be held open by a background process; giving up!
152	2024-10-31T21:09:13.458Z	exec warning: : stderr descriptor may be held open by a background process; giving up!

153	2024-10-31T21:09:13.469Z	found 13 output files
154	2024-10-31T21:09:13.469Z	uploading: /tmp/test-repair-out.txt (2398653 bytes)
155	2024-10-31T21:09:14.526Z	uploaded: /tmp/test-repair-out.txt
156	2024-10-31T21:09:14.526Z	uploading: /tmp/test_repair_ds8810.txt (35924 bytes)
157	2024-10-31T21:09:15.538Z	uploaded: /tmp/test_repair_ds8810.txt
158	2024-10-31T21:09:15.538Z	uploading: /tmp/test_repair_ds8820.txt (49425 bytes)
159	2024-10-31T21:09:16.549Z	uploaded: /tmp/test_repair_ds8820.txt
160	2024-10-31T21:09:16.552Z	uploading: /tmp/test_repair_ds8830.txt (12723 bytes)
161	2024-10-31T21:09:17.558Z	uploaded: /tmp/test_repair_ds8830.txt
162	2024-10-31T21:09:17.558Z	uploading: /tmp/test_repair_out.txt (47278 bytes)
163	2024-10-31T21:09:18.568Z	uploaded: /tmp/test_repair_out.txt
164	2024-10-31T21:09:18.573Z	uploading: /tmp/debug/df.txt (1270 bytes)
165	2024-10-31T21:09:19.576Z	uploaded: /tmp/debug/df.txt
166	2024-10-31T21:09:19.576Z	uploading: /tmp/debug/dtrace.txt (4065482 bytes)
167	2024-10-31T21:09:20.651Z	uploaded: /tmp/debug/dtrace.txt
168	2024-10-31T21:09:20.651Z	uploading: /tmp/debug/iostat.txt (153306 bytes)
169	2024-10-31T21:09:20.666Z	upload warning: file "/tmp/debug/iostat.txt" changed size mid upload: 153306 -> 155706
170	2024-10-31T21:09:21.673Z	uploaded: /tmp/debug/iostat.txt
171	2024-10-31T21:09:21.673Z	uploading: /tmp/debug/mpstat.txt (372576 bytes)
172	2024-10-31T21:09:21.698Z	upload warning: file "/tmp/debug/mpstat.txt" changed size mid upload: 372576 -> 379137
173	2024-10-31T21:09:22.703Z	uploaded: /tmp/debug/mpstat.txt
174	2024-10-31T21:09:22.706Z	uploading: /tmp/debug/paging.txt (66981 bytes)
175	2024-10-31T21:09:22.714Z	upload warning: file "/tmp/debug/paging.txt" changed size mid upload: 66981 -> 68289
176	2024-10-31T21:09:23.719Z	uploaded: /tmp/debug/paging.txt
177	2024-10-31T21:09:23.721Z	uploading: /tmp/debug/prstat.txt (714751 bytes)
178	2024-10-31T21:09:23.755Z	upload warning: file "/tmp/debug/prstat.txt" changed size mid upload: 714751 -> 727681
179	2024-10-31T21:09:24.760Z	uploaded: /tmp/debug/prstat.txt
180	2024-10-31T21:09:24.760Z	uploading: /tmp/debug/psrinfo.txt (1528 bytes)
181	2024-10-31T21:09:25.770Z	uploaded: /tmp/debug/psrinfo.txt
182	2024-10-31T21:09:25.770Z	uploading: /tmp/debug/upstairs-info.txt (66360 bytes)
183	2024-10-31T21:09:26.784Z	uploaded: /tmp/debug/upstairs-info.txt

01JBJ5476X1B089XQKA7MXN8W0: test-repair

Buildomat Job: 01JBJ54Q8MWY6K2A16VEW6YPY1

Tags:

Artefacts:

Output: