Max level shown:
12026-01-13T18:04:11.177ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:50076
22026-01-13T18:04:11.178ZINFOcrucible-agent (datafile): region 169c5572-73c5-44ba-a835-a81ca158003a state: Requested
32026-01-13T18:04:11.179ZINFOcrucible-agent (dropshot): request completed latency_us = 1041 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50076 req_id = 5a705164-f87b-48ef-a004-2c23fd007222 response_code = 200 uri = /crucible/0/regions
42026-01-13T18:04:11.179ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-13T18:04:11.187ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/169c5572-73c5-44ba-a835-a81ca158003a
62026-01-13T18:04:11.187ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/169c5572-73c5-44ba-a835-a81ca158003a
72026-01-13T18:04:11.248ZINFOcrucible-agent (worker): creating region Region { id: RegionId("169c5572-73c5-44ba-a835-a81ca158003a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/169c5572-73c5-44ba-a835-a81ca158003a" region = 169c5572-73c5-44ba-a835-a81ca158003a
82026-01-13T18:04:11.248ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "169c5572-73c5-44ba-a835-a81ca158003a" "--data" "/data/regions/169c5572-73c5-44ba-a835-a81ca158003a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 169c5572-73c5-44ba-a835-a81ca158003a
92026-01-13T18:04:11.333ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50076 req_id = ac2056bd-c346-40bc-a7b4-5732b62b48e1 response_code = 200 uri = /crucible/0/regions
102026-01-13T18:04:11.334ZINFOcrucible-agent (worker): region files created ok region = 169c5572-73c5-44ba-a835-a81ca158003a
112026-01-13T18:04:11.334ZINFOcrucible-agent (datafile): region 169c5572-73c5-44ba-a835-a81ca158003a state: Requested -> Created
122026-01-13T18:04:11.334ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-13T18:04:11.335ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-169c5572-73c5-44ba-a835-a81ca158003a
142026-01-13T18:04:11.352ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-169c5572-73c5-44ba-a835-a81ca158003a
152026-01-13T18:04:11.371ZINFOcrucible-agent (worker): creating config property group
162026-01-13T18:04:11.374ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-169c5572-73c5-44ba-a835-a81ca158003a
172026-01-13T18:04:11.375ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/169c5572-73c5-44ba-a835-a81ca158003a
182026-01-13T18:04:11.375ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-01-13T18:04:11.375ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-01-13T18:04:11.375ZINFOcrucible-agent (worker): commit
212026-01-13T18:04:11.380ZINFOcrucible-agent (worker): ok!
222026-01-13T18:04:11.399ZINFOcrucible-agent (worker): SMF ok!
232026-01-13T18:04:11.743ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50076 req_id = bc5a47b3-1005-4758-ad69-01cbe543f110 response_code = 200 uri = /crucible/0/regions
242026-01-13T18:04:12.988ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:50076 req_id = 9672fc5e-36d3-4243-9f1f-4c579396037e response_code = 200 uri = /crucible/0/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c
252026-01-13T18:04:12.991ZINFOcrucible-agent (datafile): path is "/data/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c"
262026-01-13T18:04:12.998ZINFOcrucible-agent (datafile): dataset is oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c
272026-01-13T18:04:13.004ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c@a167483b-6003-47c7-8a84-b8f862e753cf
282026-01-13T18:04:13.004ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c", "a167483b-6003-47c7-8a84-b8f862e753cf"]
292026-01-13T18:04:13.013ZINFOcrucible-agent (dropshot): request completed latency_us = 22160 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:50076 req_id = a6e19979-eaf4-47bf-87cf-c1aafce93562 response_code = 200 uri = /crucible/0/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c/snapshots/a167483b-6003-47c7-8a84-b8f862e753cf
302026-01-13T18:04:13.017ZINFOcrucible-agent (datafile): path is "/data/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c"
312026-01-13T18:04:13.023ZINFOcrucible-agent (datafile): dataset is oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c
322026-01-13T18:04:13.029ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c@a167483b-6003-47c7-8a84-b8f862e753cf
332026-01-13T18:04:13.029ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c", "a167483b-6003-47c7-8a84-b8f862e753cf"]
342026-01-13T18:04:13.037ZINFOcrucible-agent (datafile): requesting running snapshot bd40947c-a05c-4c5b-a1a7-4a6c5364512c-a167483b-6003-47c7-8a84-b8f862e753cf state: Requested
352026-01-13T18:04:13.037ZINFOcrucible-agent (dropshot): request completed latency_us = 19983 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50076 req_id = 3426aff3-cd94-4d6c-b458-f5827d81d7c6 response_code = 200 uri = /crucible/0/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c/snapshots/a167483b-6003-47c7-8a84-b8f862e753cf/run
362026-01-13T18:04:13.037ZINFOcrucible-agent (worker): applying SMF actions for region bd40947c-a05c-4c5b-a1a7-4a6c5364512c running snapshot a167483b-6003-47c7-8a84-b8f862e753cf (state Requested)...
372026-01-13T18:04:13.042ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-bd40947c-a05c-4c5b-a1a7-4a6c5364512c-a167483b-6003-47c7-8a84-b8f862e753cf
382026-01-13T18:04:13.046ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-bd40947c-a05c-4c5b-a1a7-4a6c5364512c-a167483b-6003-47c7-8a84-b8f862e753cf
392026-01-13T18:04:13.055ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-bd40947c-a05c-4c5b-a1a7-4a6c5364512c-a167483b-6003-47c7-8a84-b8f862e753cf
402026-01-13T18:04:13.056ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c/.zfs/snapshot/a167483b-6003-47c7-8a84-b8f862e753cf
412026-01-13T18:04:13.056ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-01-13T18:04:13.056ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-01-13T18:04:13.056ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
442026-01-13T18:04:13.056ZINFOcrucible-agent (worker): commit
452026-01-13T18:04:13.060ZINFOcrucible-agent (worker): ok!
462026-01-13T18:04:13.064ZINFOcrucible-agent (worker): SMF ok!
472026-01-13T18:04:13.064ZINFOcrucible-agent (datafile): region bd40947c-a05c-4c5b-a1a7-4a6c5364512c running snapshot a167483b-6003-47c7-8a84-b8f862e753cf state: Requested -> Created
482026-01-13T18:04:13.212ZINFOcrucible-agent (datafile): path is "/data/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c"
492026-01-13T18:04:13.218ZINFOcrucible-agent (datafile): dataset is oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c
502026-01-13T18:04:13.224ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c@a167483b-6003-47c7-8a84-b8f862e753cf
512026-01-13T18:04:13.224ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a675cd43-4de1-40ea-85b9-542783e19ba2/crucible/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c", "a167483b-6003-47c7-8a84-b8f862e753cf"]
522026-01-13T18:04:13.230ZINFOcrucible-agent (dropshot): request completed latency_us = 17843 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50076 req_id = a9a89b90-be99-4170-9d12-42de11d6cfa5 response_code = 200 uri = /crucible/0/regions/bd40947c-a05c-4c5b-a1a7-4a6c5364512c/snapshots/a167483b-6003-47c7-8a84-b8f862e753cf/run