Max level shown:
12026-02-03T20:45:11.691ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:46685
22026-02-03T20:45:11.719ZINFOcrucible-agent (datafile): region 5db9816c-0067-4f73-bb51-3a12800801cf state: Requested
32026-02-03T20:45:11.722ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-02-03T20:45:11.722ZINFOcrucible-agent (dropshot): request completed latency_us = 13686 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:46685 req_id = 0cebfd80-006f-403c-8be5-ef143833e238 response_code = 200 uri = /crucible/0/regions
52026-02-03T20:45:11.732ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf
62026-02-03T20:45:11.732ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf
72026-02-03T20:45:11.796ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5db9816c-0067-4f73-bb51-3a12800801cf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5db9816c-0067-4f73-bb51-3a12800801cf" region = 5db9816c-0067-4f73-bb51-3a12800801cf
82026-02-03T20:45:11.798ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5db9816c-0067-4f73-bb51-3a12800801cf" "--data" "/data/regions/5db9816c-0067-4f73-bb51-3a12800801cf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5db9816c-0067-4f73-bb51-3a12800801cf
92026-02-03T20:45:11.972ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:46685 req_id = 894cc75e-96cb-4ed9-9fa0-8bca067a4eb5 response_code = 200 uri = /crucible/0/regions
102026-02-03T20:45:12.187ZINFOcrucible-agent (worker): region files created ok region = 5db9816c-0067-4f73-bb51-3a12800801cf
112026-02-03T20:45:12.187ZINFOcrucible-agent (datafile): region 5db9816c-0067-4f73-bb51-3a12800801cf state: Requested -> Created
122026-02-03T20:45:12.187ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-02-03T20:45:12.187ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5db9816c-0067-4f73-bb51-3a12800801cf
142026-02-03T20:45:12.199ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5db9816c-0067-4f73-bb51-3a12800801cf
152026-02-03T20:45:12.214ZINFOcrucible-agent (worker): creating config property group
162026-02-03T20:45:12.218ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5db9816c-0067-4f73-bb51-3a12800801cf
172026-02-03T20:45:12.219ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5db9816c-0067-4f73-bb51-3a12800801cf
182026-02-03T20:45:12.219ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-02-03T20:45:12.219ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-02-03T20:45:12.219ZINFOcrucible-agent (worker): commit
212026-02-03T20:45:12.224ZINFOcrucible-agent (worker): ok!
222026-02-03T20:45:12.229ZINFOcrucible-agent (worker): SMF ok!
232026-02-03T20:45:12.545ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:46685 req_id = 2de968ed-657f-4ee1-b805-53ac173b26f6 response_code = 200 uri = /crucible/0/regions
242026-02-03T20:56:41.203ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:56070
252026-02-03T20:56:41.204ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:56070 req_id = 68f215db-606f-4840-b36e-cfca7cac9134 response_code = 200 uri = /crucible/0/regions/5db9816c-0067-4f73-bb51-3a12800801cf
262026-02-03T20:56:41.206ZINFOcrucible-agent (datafile): path is "/data/regions/5db9816c-0067-4f73-bb51-3a12800801cf"
272026-02-03T20:56:41.212ZINFOcrucible-agent (datafile): dataset is oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf
282026-02-03T20:56:41.217ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf@2682257c-d8d3-45f9-b9ad-cb02874c4d6f
292026-02-03T20:56:41.217ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf", "2682257c-d8d3-45f9-b9ad-cb02874c4d6f"]
302026-02-03T20:56:41.226ZINFOcrucible-agent (dropshot): request completed latency_us = 19939 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:56070 req_id = b6413074-3252-4873-a97a-8679966da04b response_code = 200 uri = /crucible/0/regions/5db9816c-0067-4f73-bb51-3a12800801cf/snapshots/2682257c-d8d3-45f9-b9ad-cb02874c4d6f
312026-02-03T20:56:41.229ZINFOcrucible-agent (datafile): path is "/data/regions/5db9816c-0067-4f73-bb51-3a12800801cf"
322026-02-03T20:56:41.236ZINFOcrucible-agent (datafile): dataset is oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf
332026-02-03T20:56:41.241ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf@2682257c-d8d3-45f9-b9ad-cb02874c4d6f
342026-02-03T20:56:41.241ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf", "2682257c-d8d3-45f9-b9ad-cb02874c4d6f"]
352026-02-03T20:56:41.250ZINFOcrucible-agent (datafile): requesting running snapshot 5db9816c-0067-4f73-bb51-3a12800801cf-2682257c-d8d3-45f9-b9ad-cb02874c4d6f state: Requested
362026-02-03T20:56:41.255ZINFOcrucible-agent (dropshot): request completed latency_us = 25748 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:56070 req_id = d360678d-166e-442d-af97-4aa3c27a6686 response_code = 200 uri = /crucible/0/regions/5db9816c-0067-4f73-bb51-3a12800801cf/snapshots/2682257c-d8d3-45f9-b9ad-cb02874c4d6f/run
372026-02-03T20:56:41.255ZINFOcrucible-agent (worker): applying SMF actions for region 5db9816c-0067-4f73-bb51-3a12800801cf running snapshot 2682257c-d8d3-45f9-b9ad-cb02874c4d6f (state Requested)...
382026-02-03T20:56:41.275ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5db9816c-0067-4f73-bb51-3a12800801cf-2682257c-d8d3-45f9-b9ad-cb02874c4d6f
392026-02-03T20:56:41.287ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5db9816c-0067-4f73-bb51-3a12800801cf-2682257c-d8d3-45f9-b9ad-cb02874c4d6f
402026-02-03T20:56:41.313ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5db9816c-0067-4f73-bb51-3a12800801cf-2682257c-d8d3-45f9-b9ad-cb02874c4d6f
412026-02-03T20:56:41.314ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5db9816c-0067-4f73-bb51-3a12800801cf/.zfs/snapshot/2682257c-d8d3-45f9-b9ad-cb02874c4d6f
422026-02-03T20:56:41.314ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432026-02-03T20:56:41.314ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442026-02-03T20:56:41.314ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
452026-02-03T20:56:41.314ZINFOcrucible-agent (worker): commit
462026-02-03T20:56:41.323ZINFOcrucible-agent (worker): ok!
472026-02-03T20:56:41.338ZINFOcrucible-agent (worker): SMF ok!
482026-02-03T20:56:41.338ZINFOcrucible-agent (datafile): region 5db9816c-0067-4f73-bb51-3a12800801cf running snapshot 2682257c-d8d3-45f9-b9ad-cb02874c4d6f state: Requested -> Created
492026-02-03T20:56:41.560ZINFOcrucible-agent (datafile): path is "/data/regions/5db9816c-0067-4f73-bb51-3a12800801cf"
502026-02-03T20:56:41.566ZINFOcrucible-agent (datafile): dataset is oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf
512026-02-03T20:56:41.573ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf@2682257c-d8d3-45f9-b9ad-cb02874c4d6f
522026-02-03T20:56:41.573ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b069dbb8-33ff-4c01-9242-f3f9500c6bb1/crucible/regions/5db9816c-0067-4f73-bb51-3a12800801cf", "2682257c-d8d3-45f9-b9ad-cb02874c4d6f"]
532026-02-03T20:56:41.580ZINFOcrucible-agent (dropshot): request completed latency_us = 19887 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:56070 req_id = 7de9448f-172e-4792-9647-9c1b79c10f61 response_code = 200 uri = /crucible/0/regions/5db9816c-0067-4f73-bb51-3a12800801cf/snapshots/2682257c-d8d3-45f9-b9ad-cb02874c4d6f/run