Max level shown:
12024-07-29T22:46:15.247ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:35566
22024-07-29T22:46:15.248ZINFOcrucible-agent (datafile): region a1266b0d-1549-4e70-b3c5-e276aafd7620 state: Requested
32024-07-29T22:46:15.251ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-07-29T22:46:15.251ZINFOcrucible-agent (dropshot): request completed latency_us = 3614 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35566 req_id = d7c03820-7fc2-4b70-840c-f09dc820131d response_code = 200 uri = /crucible/0/regions
52024-07-29T22:46:15.262ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_52ee60ab-a8a0-45da-931e-f84445fb42ad/crucible/regions/a1266b0d-1549-4e70-b3c5-e276aafd7620
62024-07-29T22:46:15.262ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_52ee60ab-a8a0-45da-931e-f84445fb42ad/crucible/regions/a1266b0d-1549-4e70-b3c5-e276aafd7620
72024-07-29T22:46:15.316ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a1266b0d-1549-4e70-b3c5-e276aafd7620"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a1266b0d-1549-4e70-b3c5-e276aafd7620" region = a1266b0d-1549-4e70-b3c5-e276aafd7620
82024-07-29T22:46:15.316ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a1266b0d-1549-4e70-b3c5-e276aafd7620" "--data" "/data/regions/a1266b0d-1549-4e70-b3c5-e276aafd7620" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a1266b0d-1549-4e70-b3c5-e276aafd7620
92024-07-29T22:46:15.391ZINFOcrucible-agent (worker): region files created ok region = a1266b0d-1549-4e70-b3c5-e276aafd7620
102024-07-29T22:46:15.391ZINFOcrucible-agent (datafile): region a1266b0d-1549-4e70-b3c5-e276aafd7620 state: Requested -> Created
112024-07-29T22:46:15.391ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-07-29T22:46:15.396ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35566 req_id = b609a99b-2f6d-498a-acf1-c037e20cb97b response_code = 200 uri = /crucible/0/regions
132024-07-29T22:46:15.399ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d
142024-07-29T22:46:15.399ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
152024-07-29T22:46:15.400ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
162024-07-29T22:46:15.400ZINFOcrucible-agent (worker): reconfig required
172024-07-29T22:46:15.400ZINFOcrucible-agent (worker): using existing config property group
182024-07-29T22:46:15.400ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a044bf6b-ea30-4223-934e-9f8b5f335a4d
192024-07-29T22:46:15.400ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d
202024-07-29T22:46:15.400ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
212024-07-29T22:46:15.400ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
222024-07-29T22:46:15.400ZINFOcrucible-agent (worker): commit
232024-07-29T22:46:15.406ZINFOcrucible-agent (worker): ok!
242024-07-29T22:46:15.407ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a1266b0d-1549-4e70-b3c5-e276aafd7620
252024-07-29T22:46:15.411ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a1266b0d-1549-4e70-b3c5-e276aafd7620
262024-07-29T22:46:15.420ZINFOcrucible-agent (worker): creating config property group
272024-07-29T22:46:15.422ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a1266b0d-1549-4e70-b3c5-e276aafd7620
282024-07-29T22:46:15.423ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a1266b0d-1549-4e70-b3c5-e276aafd7620
292024-07-29T22:46:15.423ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
302024-07-29T22:46:15.423ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
312024-07-29T22:46:15.423ZINFOcrucible-agent (worker): commit
322024-07-29T22:46:15.427ZINFOcrucible-agent (worker): ok!
332024-07-29T22:46:15.431ZINFOcrucible-agent (worker): SMF ok!
342024-07-29T22:46:16.400ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:55895
352024-07-29T22:46:16.403ZINFOcrucible-agent (dropshot): request completed latency_us = 2419 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55895 req_id = 9646b371-5322-4990-926e-0fa3420ceaa4 response_code = 200 uri = /crucible/0/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d
362024-07-29T22:46:16.405ZINFOcrucible-agent (datafile): path is "/data/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d"
372024-07-29T22:46:16.415ZINFOcrucible-agent (datafile): dataset is oxp_52ee60ab-a8a0-45da-931e-f84445fb42ad/crucible/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d
382024-07-29T22:46:16.424ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_52ee60ab-a8a0-45da-931e-f84445fb42ad/crucible/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d@fdbce13f-1958-413b-b274-4950ad3f94e7
392024-07-29T22:46:16.424ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_52ee60ab-a8a0-45da-931e-f84445fb42ad/crucible/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d", "fdbce13f-1958-413b-b274-4950ad3f94e7"]
402024-07-29T22:46:16.436ZINFOcrucible-agent (dropshot): request completed latency_us = 32820 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55895 req_id = e2b28720-f1d7-4519-91be-e60fe3a202ca response_code = 200 uri = /crucible/0/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d/snapshots/fdbce13f-1958-413b-b274-4950ad3f94e7
412024-07-29T22:46:16.438ZINFOcrucible-agent (datafile): path is "/data/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d"
422024-07-29T22:46:16.445ZINFOcrucible-agent (datafile): dataset is oxp_52ee60ab-a8a0-45da-931e-f84445fb42ad/crucible/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d
432024-07-29T22:46:16.452ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_52ee60ab-a8a0-45da-931e-f84445fb42ad/crucible/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d@fdbce13f-1958-413b-b274-4950ad3f94e7
442024-07-29T22:46:16.452ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_52ee60ab-a8a0-45da-931e-f84445fb42ad/crucible/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d", "fdbce13f-1958-413b-b274-4950ad3f94e7"]
452024-07-29T22:46:16.461ZINFOcrucible-agent (datafile): requesting running snapshot a044bf6b-ea30-4223-934e-9f8b5f335a4d-fdbce13f-1958-413b-b274-4950ad3f94e7 state: Requested
462024-07-29T22:46:16.461ZINFOcrucible-agent (worker): applying SMF actions for region a044bf6b-ea30-4223-934e-9f8b5f335a4d running snapshot fdbce13f-1958-413b-b274-4950ad3f94e7 (state Requested)...
472024-07-29T22:46:16.461ZINFOcrucible-agent (dropshot): request completed latency_us = 23224 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55895 req_id = 0d2ae577-f7a3-46f7-8cd7-c9066c45f969 response_code = 200 uri = /crucible/0/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d/snapshots/fdbce13f-1958-413b-b274-4950ad3f94e7/run
482024-07-29T22:46:16.462ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d
492024-07-29T22:46:16.462ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
502024-07-29T22:46:16.462ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
512024-07-29T22:46:16.462ZINFOcrucible-agent (worker): reconfig required
522024-07-29T22:46:16.462ZINFOcrucible-agent (worker): using existing config property group
532024-07-29T22:46:16.462ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a044bf6b-ea30-4223-934e-9f8b5f335a4d
542024-07-29T22:46:16.462ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d
552024-07-29T22:46:16.463ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
562024-07-29T22:46:16.463ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
572024-07-29T22:46:16.463ZINFOcrucible-agent (worker): commit
582024-07-29T22:46:16.467ZINFOcrucible-agent (worker): ok!
592024-07-29T22:46:16.468ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a044bf6b-ea30-4223-934e-9f8b5f335a4d-fdbce13f-1958-413b-b274-4950ad3f94e7
602024-07-29T22:46:16.474ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a044bf6b-ea30-4223-934e-9f8b5f335a4d-fdbce13f-1958-413b-b274-4950ad3f94e7
612024-07-29T22:46:16.484ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a044bf6b-ea30-4223-934e-9f8b5f335a4d-fdbce13f-1958-413b-b274-4950ad3f94e7
622024-07-29T22:46:16.485ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a044bf6b-ea30-4223-934e-9f8b5f335a4d/.zfs/snapshot/fdbce13f-1958-413b-b274-4950ad3f94e7
632024-07-29T22:46:16.485ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
642024-07-29T22:46:16.485ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-07-29T22:46:16.485ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
662024-07-29T22:46:16.485ZINFOcrucible-agent (worker): commit
672024-07-29T22:46:16.488ZINFOcrucible-agent (worker): ok!
682024-07-29T22:46:16.493ZINFOcrucible-agent (worker): SMF ok!
692024-07-29T22:46:16.493ZINFOcrucible-agent (datafile): region a044bf6b-ea30-4223-934e-9f8b5f335a4d running snapshot fdbce13f-1958-413b-b274-4950ad3f94e7 state: Requested -> Created