Max level shown:
12026-02-24T02:34:30.065ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:64872
22026-02-24T02:34:30.065ZINFOcrucible-agent (datafile): region f7a9f095-fd5e-429b-9a95-994401278a47 state: Requested
32026-02-24T02:34:30.066ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-02-24T02:34:30.066ZINFOcrucible-agent (dropshot): request completed latency_us = 682 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64872 req_id = f71d31a0-bb50-4f2b-8422-561790ffa097 response_code = 200 uri = /crucible/0/regions
52026-02-24T02:34:30.075ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/f7a9f095-fd5e-429b-9a95-994401278a47
62026-02-24T02:34:30.075ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/f7a9f095-fd5e-429b-9a95-994401278a47
72026-02-24T02:34:30.121ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f7a9f095-fd5e-429b-9a95-994401278a47"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f7a9f095-fd5e-429b-9a95-994401278a47" region = f7a9f095-fd5e-429b-9a95-994401278a47
82026-02-24T02:34:30.121ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f7a9f095-fd5e-429b-9a95-994401278a47" "--data" "/data/regions/f7a9f095-fd5e-429b-9a95-994401278a47" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f7a9f095-fd5e-429b-9a95-994401278a47
92026-02-24T02:34:30.198ZINFOcrucible-agent (worker): region files created ok region = f7a9f095-fd5e-429b-9a95-994401278a47
102026-02-24T02:34:30.198ZINFOcrucible-agent (datafile): region f7a9f095-fd5e-429b-9a95-994401278a47 state: Requested -> Created
112026-02-24T02:34:30.199ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-02-24T02:34:30.218ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f7a9f095-fd5e-429b-9a95-994401278a47
132026-02-24T02:34:30.228ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f7a9f095-fd5e-429b-9a95-994401278a47
142026-02-24T02:34:30.240ZINFOcrucible-agent (worker): creating config property group
152026-02-24T02:34:30.243ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f7a9f095-fd5e-429b-9a95-994401278a47
162026-02-24T02:34:30.244ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f7a9f095-fd5e-429b-9a95-994401278a47
172026-02-24T02:34:30.244ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-02-24T02:34:30.244ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192026-02-24T02:34:30.244ZINFOcrucible-agent (worker): commit
202026-02-24T02:34:30.248ZINFOcrucible-agent (worker): ok!
212026-02-24T02:34:30.254ZINFOcrucible-agent (worker): SMF ok!
222026-02-24T02:34:30.432ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64872 req_id = b9dc5486-667b-4a5f-8239-fd6a4bdfda75 response_code = 200 uri = /crucible/0/regions
232026-02-24T02:34:30.816ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64872 req_id = ebf24d55-3f5b-44f2-96fa-d41ad80955cb response_code = 200 uri = /crucible/0/regions/baa038f6-9523-4861-8583-02ea0dfa3f94
242026-02-24T02:34:30.821ZINFOcrucible-agent (datafile): path is "/data/regions/baa038f6-9523-4861-8583-02ea0dfa3f94"
252026-02-24T02:34:30.827ZINFOcrucible-agent (datafile): dataset is oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94
262026-02-24T02:34:30.834ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94@53a934f6-d542-4134-bed9-a4f304b74bc8
272026-02-24T02:34:30.834ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94", "53a934f6-d542-4134-bed9-a4f304b74bc8"]
282026-02-24T02:34:30.843ZINFOcrucible-agent (dropshot): request completed latency_us = 22328 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64872 req_id = 68be7dee-7bdc-4737-9c30-cdebf78663a7 response_code = 200 uri = /crucible/0/regions/baa038f6-9523-4861-8583-02ea0dfa3f94/snapshots/53a934f6-d542-4134-bed9-a4f304b74bc8
292026-02-24T02:34:30.847ZINFOcrucible-agent (datafile): path is "/data/regions/baa038f6-9523-4861-8583-02ea0dfa3f94"
302026-02-24T02:34:30.853ZINFOcrucible-agent (datafile): dataset is oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94
312026-02-24T02:34:30.859ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94@53a934f6-d542-4134-bed9-a4f304b74bc8
322026-02-24T02:34:30.859ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94", "53a934f6-d542-4134-bed9-a4f304b74bc8"]
332026-02-24T02:34:30.867ZINFOcrucible-agent (datafile): requesting running snapshot baa038f6-9523-4861-8583-02ea0dfa3f94-53a934f6-d542-4134-bed9-a4f304b74bc8 state: Requested
342026-02-24T02:34:30.867ZINFOcrucible-agent (worker): applying SMF actions for region baa038f6-9523-4861-8583-02ea0dfa3f94 running snapshot 53a934f6-d542-4134-bed9-a4f304b74bc8 (state Requested)...
352026-02-24T02:34:30.867ZINFOcrucible-agent (dropshot): request completed latency_us = 20627 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64872 req_id = 1ea07c8b-7aec-45dc-80d1-a62d34a1bfbe response_code = 200 uri = /crucible/0/regions/baa038f6-9523-4861-8583-02ea0dfa3f94/snapshots/53a934f6-d542-4134-bed9-a4f304b74bc8/run
362026-02-24T02:34:30.872ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-baa038f6-9523-4861-8583-02ea0dfa3f94-53a934f6-d542-4134-bed9-a4f304b74bc8
372026-02-24T02:34:30.881ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-baa038f6-9523-4861-8583-02ea0dfa3f94-53a934f6-d542-4134-bed9-a4f304b74bc8
382026-02-24T02:34:30.891ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-baa038f6-9523-4861-8583-02ea0dfa3f94-53a934f6-d542-4134-bed9-a4f304b74bc8
392026-02-24T02:34:30.891ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/baa038f6-9523-4861-8583-02ea0dfa3f94/.zfs/snapshot/53a934f6-d542-4134-bed9-a4f304b74bc8
402026-02-24T02:34:30.891ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-02-24T02:34:30.891ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-02-24T02:34:30.891ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432026-02-24T02:34:30.891ZINFOcrucible-agent (worker): commit
442026-02-24T02:34:30.895ZINFOcrucible-agent (worker): ok!
452026-02-24T02:34:30.900ZINFOcrucible-agent (worker): SMF ok!
462026-02-24T02:34:30.900ZINFOcrucible-agent (datafile): region baa038f6-9523-4861-8583-02ea0dfa3f94 running snapshot 53a934f6-d542-4134-bed9-a4f304b74bc8 state: Requested -> Created
472026-02-24T02:34:31.012ZINFOcrucible-agent (datafile): path is "/data/regions/baa038f6-9523-4861-8583-02ea0dfa3f94"
482026-02-24T02:34:31.018ZINFOcrucible-agent (datafile): dataset is oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94
492026-02-24T02:34:31.024ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94@53a934f6-d542-4134-bed9-a4f304b74bc8
502026-02-24T02:34:31.024ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_946c6df9-1ffe-47da-95af-db26fa21cdcf/crucible/regions/baa038f6-9523-4861-8583-02ea0dfa3f94", "53a934f6-d542-4134-bed9-a4f304b74bc8"]
512026-02-24T02:34:31.030ZINFOcrucible-agent (dropshot): request completed latency_us = 18244 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64872 req_id = 64e799ef-5485-44f9-b5b7-f02291ac964b response_code = 200 uri = /crucible/0/regions/baa038f6-9523-4861-8583-02ea0dfa3f94/snapshots/53a934f6-d542-4134-bed9-a4f304b74bc8/run