Max level shown:
12026-08-25T21:03:54.225ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:35557
22026-08-25T21:03:54.225ZINFOcrucible-agent (datafile): region 3c869ae0-5b92-430b-aae3-3ef26cb16f3f state: Requested
32026-08-25T21:03:54.232ZINFOcrucible-agent (dropshot): request completed latency_us = 7299 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35557 req_id = 10d879d5-4c6c-4669-a5ca-e826e36d6224 response_code = 200 uri = /crucible/0/regions
42026-08-25T21:03:54.232ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-08-25T21:03:54.249ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/3c869ae0-5b92-430b-aae3-3ef26cb16f3f
62026-08-25T21:03:54.249ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/3c869ae0-5b92-430b-aae3-3ef26cb16f3f
72026-08-25T21:03:54.605ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35557 req_id = 4c27a8c3-d126-4d89-80a0-bbcda1b52813 response_code = 200 uri = /crucible/0/regions
82026-08-25T21:03:55.117ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3c869ae0-5b92-430b-aae3-3ef26cb16f3f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3c869ae0-5b92-430b-aae3-3ef26cb16f3f" region = 3c869ae0-5b92-430b-aae3-3ef26cb16f3f
92026-08-25T21:03:55.118ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3c869ae0-5b92-430b-aae3-3ef26cb16f3f" "--data" "/data/regions/3c869ae0-5b92-430b-aae3-3ef26cb16f3f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3c869ae0-5b92-430b-aae3-3ef26cb16f3f
102026-08-25T21:03:55.292ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35557 req_id = ace1660e-408f-4a2a-9c5e-7fe5d0c2497e response_code = 200 uri = /crucible/0/regions
112026-08-25T21:03:56.148ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35557 req_id = 5c3485f4-855f-4d45-86ae-8534494b39cb response_code = 200 uri = /crucible/0/regions
122026-08-25T21:03:56.519ZINFOcrucible-agent (worker): region files created ok region = 3c869ae0-5b92-430b-aae3-3ef26cb16f3f
132026-08-25T21:03:56.519ZINFOcrucible-agent (datafile): region 3c869ae0-5b92-430b-aae3-3ef26cb16f3f state: Requested -> Created
142026-08-25T21:03:56.519ZINFOcrucible-agent (worker): applying SMF actions post create...
152026-08-25T21:03:56.519ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3c869ae0-5b92-430b-aae3-3ef26cb16f3f
162026-08-25T21:03:56.549ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3c869ae0-5b92-430b-aae3-3ef26cb16f3f
172026-08-25T21:03:56.596ZINFOcrucible-agent (worker): creating config property group
182026-08-25T21:03:56.609ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3c869ae0-5b92-430b-aae3-3ef26cb16f3f
192026-08-25T21:03:56.609ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3c869ae0-5b92-430b-aae3-3ef26cb16f3f
202026-08-25T21:03:56.609ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
212026-08-25T21:03:56.609ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
222026-08-25T21:03:56.609ZINFOcrucible-agent (worker): commit
232026-08-25T21:03:56.624ZINFOcrucible-agent (worker): ok!
242026-08-25T21:03:56.642ZINFOcrucible-agent (worker): SMF ok!
252026-08-25T21:03:57.969ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35557 req_id = 84904a85-b5bd-4bad-994b-1ae645e8a1ba response_code = 200 uri = /crucible/0/regions
262026-08-25T21:03:59.980ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:35557 req_id = 08db2db7-d52b-4186-9b9e-28cba24cba70 response_code = 200 uri = /crucible/0/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142
272026-08-25T21:03:59.983ZINFOcrucible-agent (datafile): path is "/data/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142"
282026-08-25T21:03:59.990ZINFOcrucible-agent (datafile): dataset is oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142
292026-08-25T21:03:59.997ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142@34cd36df-17fa-4604-865a-3fb946aee839
302026-08-25T21:03:59.997ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142", "34cd36df-17fa-4604-865a-3fb946aee839"]
312026-08-25T21:04:00.009ZINFOcrucible-agent (dropshot): request completed latency_us = 25367 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:35557 req_id = 0ed2273f-aff1-490d-b2f2-523a0fdfbb49 response_code = 200 uri = /crucible/0/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142/snapshots/34cd36df-17fa-4604-865a-3fb946aee839
322026-08-25T21:04:00.013ZINFOcrucible-agent (datafile): path is "/data/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142"
332026-08-25T21:04:00.019ZINFOcrucible-agent (datafile): dataset is oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142
342026-08-25T21:04:00.026ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142@34cd36df-17fa-4604-865a-3fb946aee839
352026-08-25T21:04:00.026ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142", "34cd36df-17fa-4604-865a-3fb946aee839"]
362026-08-25T21:04:00.034ZINFOcrucible-agent (datafile): requesting running snapshot 84837087-1d8d-4ca4-bd30-e5a089a5d142-34cd36df-17fa-4604-865a-3fb946aee839 state: Requested
372026-08-25T21:04:00.050ZINFOcrucible-agent (worker): applying SMF actions for region 84837087-1d8d-4ca4-bd30-e5a089a5d142 running snapshot 34cd36df-17fa-4604-865a-3fb946aee839 (state Requested)...
382026-08-25T21:04:00.050ZINFOcrucible-agent (dropshot): request completed latency_us = 37991 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35557 req_id = d1f4032e-45fb-48e3-bd6c-19c156f65823 response_code = 200 uri = /crucible/0/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142/snapshots/34cd36df-17fa-4604-865a-3fb946aee839/run
392026-08-25T21:04:00.052ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-84837087-1d8d-4ca4-bd30-e5a089a5d142-34cd36df-17fa-4604-865a-3fb946aee839
402026-08-25T21:04:00.089ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-84837087-1d8d-4ca4-bd30-e5a089a5d142-34cd36df-17fa-4604-865a-3fb946aee839
412026-08-25T21:04:00.130ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-84837087-1d8d-4ca4-bd30-e5a089a5d142-34cd36df-17fa-4604-865a-3fb946aee839
422026-08-25T21:04:00.130ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142/.zfs/snapshot/34cd36df-17fa-4604-865a-3fb946aee839
432026-08-25T21:04:00.130ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
442026-08-25T21:04:00.131ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
452026-08-25T21:04:00.131ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
462026-08-25T21:04:00.131ZINFOcrucible-agent (worker): commit
472026-08-25T21:04:00.144ZINFOcrucible-agent (worker): ok!
482026-08-25T21:04:00.157ZINFOcrucible-agent (worker): SMF ok!
492026-08-25T21:04:00.157ZINFOcrucible-agent (datafile): region 84837087-1d8d-4ca4-bd30-e5a089a5d142 running snapshot 34cd36df-17fa-4604-865a-3fb946aee839 state: Requested -> Created
502026-08-25T21:04:00.333ZINFOcrucible-agent (datafile): path is "/data/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142"
512026-08-25T21:04:00.339ZINFOcrucible-agent (datafile): dataset is oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142
522026-08-25T21:04:00.344ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142@34cd36df-17fa-4604-865a-3fb946aee839
532026-08-25T21:04:00.344ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f4a20a98-11cc-4409-ab32-bceeaf0e9217/crucible/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142", "34cd36df-17fa-4604-865a-3fb946aee839"]
542026-08-25T21:04:00.350ZINFOcrucible-agent (dropshot): request completed latency_us = 17001 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35557 req_id = d9b7adc9-bbbb-40b0-813b-c68368b799ad response_code = 200 uri = /crucible/0/regions/84837087-1d8d-4ca4-bd30-e5a089a5d142/snapshots/34cd36df-17fa-4604-865a-3fb946aee839/run