Max level shown:
12026-04-14T13:53:52.373ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:33733
22026-04-14T13:53:52.373ZINFOcrucible-agent (datafile): region 11a099c8-4b99-4c72-b8c5-5527bdf31aa7 state: Requested
32026-04-14T13:53:52.374ZINFOcrucible-agent (dropshot): request completed latency_us = 677 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33733 req_id = 41e0fdd2-ecbe-4b52-be13-1a44859d99ef response_code = 200 uri = /crucible/0/regions
42026-04-14T13:53:52.374ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-04-14T13:53:52.386ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/11a099c8-4b99-4c72-b8c5-5527bdf31aa7
62026-04-14T13:53:52.386ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/11a099c8-4b99-4c72-b8c5-5527bdf31aa7
72026-04-14T13:53:52.456ZINFOcrucible-agent (worker): creating region Region { id: RegionId("11a099c8-4b99-4c72-b8c5-5527bdf31aa7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/11a099c8-4b99-4c72-b8c5-5527bdf31aa7" region = 11a099c8-4b99-4c72-b8c5-5527bdf31aa7
82026-04-14T13:53:52.456ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "11a099c8-4b99-4c72-b8c5-5527bdf31aa7" "--data" "/data/regions/11a099c8-4b99-4c72-b8c5-5527bdf31aa7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 11a099c8-4b99-4c72-b8c5-5527bdf31aa7
92026-04-14T13:53:52.648ZINFOcrucible-agent (worker): region files created ok region = 11a099c8-4b99-4c72-b8c5-5527bdf31aa7
102026-04-14T13:53:52.648ZINFOcrucible-agent (datafile): region 11a099c8-4b99-4c72-b8c5-5527bdf31aa7 state: Requested -> Created
112026-04-14T13:53:52.648ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-04-14T13:53:52.649ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-11a099c8-4b99-4c72-b8c5-5527bdf31aa7
132026-04-14T13:53:52.680ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-11a099c8-4b99-4c72-b8c5-5527bdf31aa7
142026-04-14T13:53:52.720ZINFOcrucible-agent (worker): creating config property group
152026-04-14T13:53:52.734ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-11a099c8-4b99-4c72-b8c5-5527bdf31aa7
162026-04-14T13:53:52.734ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33733 req_id = 067833a3-6487-4133-83eb-56738a888eb3 response_code = 200 uri = /crucible/0/regions
172026-04-14T13:53:52.734ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/11a099c8-4b99-4c72-b8c5-5527bdf31aa7
182026-04-14T13:53:52.734ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-04-14T13:53:52.734ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-04-14T13:53:52.734ZINFOcrucible-agent (worker): commit
212026-04-14T13:53:52.748ZINFOcrucible-agent (worker): ok!
222026-04-14T13:53:52.796ZINFOcrucible-agent (worker): SMF ok!
232026-04-14T13:53:53.912ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33733 req_id = 5d73aabf-44a3-4b1d-b681-a8481fc04855 response_code = 200 uri = /crucible/0/regions/a72e1deb-1dab-496e-a496-1cff7177863c
242026-04-14T13:53:53.919ZINFOcrucible-agent (datafile): path is "/data/regions/a72e1deb-1dab-496e-a496-1cff7177863c"
252026-04-14T13:53:53.933ZINFOcrucible-agent (datafile): dataset is oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c
262026-04-14T13:53:53.945ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c@c0dd9fd2-361b-40bc-8bb5-b6360bcb058f
272026-04-14T13:53:53.945ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c", "c0dd9fd2-361b-40bc-8bb5-b6360bcb058f"]
282026-04-14T13:53:53.962ZINFOcrucible-agent (dropshot): request completed latency_us = 43425 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33733 req_id = b54f9a5b-67fc-43aa-bfc8-38ca2a411244 response_code = 200 uri = /crucible/0/regions/a72e1deb-1dab-496e-a496-1cff7177863c/snapshots/c0dd9fd2-361b-40bc-8bb5-b6360bcb058f
292026-04-14T13:53:54.013ZINFOcrucible-agent (datafile): path is "/data/regions/a72e1deb-1dab-496e-a496-1cff7177863c"
302026-04-14T13:53:54.025ZINFOcrucible-agent (datafile): dataset is oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c
312026-04-14T13:53:54.036ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c@c0dd9fd2-361b-40bc-8bb5-b6360bcb058f
322026-04-14T13:53:54.036ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c", "c0dd9fd2-361b-40bc-8bb5-b6360bcb058f"]
332026-04-14T13:53:54.055ZINFOcrucible-agent (datafile): requesting running snapshot a72e1deb-1dab-496e-a496-1cff7177863c-c0dd9fd2-361b-40bc-8bb5-b6360bcb058f state: Requested
342026-04-14T13:53:54.055ZINFOcrucible-agent (worker): applying SMF actions for region a72e1deb-1dab-496e-a496-1cff7177863c running snapshot c0dd9fd2-361b-40bc-8bb5-b6360bcb058f (state Requested)...
352026-04-14T13:53:54.055ZINFOcrucible-agent (dropshot): request completed latency_us = 42370 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33733 req_id = e553531d-2cc0-4890-8af5-949fa3256011 response_code = 200 uri = /crucible/0/regions/a72e1deb-1dab-496e-a496-1cff7177863c/snapshots/c0dd9fd2-361b-40bc-8bb5-b6360bcb058f/run
362026-04-14T13:53:54.061ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a72e1deb-1dab-496e-a496-1cff7177863c-c0dd9fd2-361b-40bc-8bb5-b6360bcb058f
372026-04-14T13:53:54.085ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a72e1deb-1dab-496e-a496-1cff7177863c-c0dd9fd2-361b-40bc-8bb5-b6360bcb058f
382026-04-14T13:53:54.120ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a72e1deb-1dab-496e-a496-1cff7177863c-c0dd9fd2-361b-40bc-8bb5-b6360bcb058f
392026-04-14T13:53:54.121ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a72e1deb-1dab-496e-a496-1cff7177863c/.zfs/snapshot/c0dd9fd2-361b-40bc-8bb5-b6360bcb058f
402026-04-14T13:53:54.121ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-04-14T13:53:54.121ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-04-14T13:53:54.121ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432026-04-14T13:53:54.121ZINFOcrucible-agent (worker): commit
442026-04-14T13:53:54.132ZINFOcrucible-agent (worker): ok!
452026-04-14T13:53:54.145ZINFOcrucible-agent (worker): SMF ok!
462026-04-14T13:53:54.145ZINFOcrucible-agent (datafile): region a72e1deb-1dab-496e-a496-1cff7177863c running snapshot c0dd9fd2-361b-40bc-8bb5-b6360bcb058f state: Requested -> Created
472026-04-14T13:53:54.241ZINFOcrucible-agent (datafile): path is "/data/regions/a72e1deb-1dab-496e-a496-1cff7177863c"
482026-04-14T13:53:54.248ZINFOcrucible-agent (datafile): dataset is oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c
492026-04-14T13:53:54.255ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c@c0dd9fd2-361b-40bc-8bb5-b6360bcb058f
502026-04-14T13:53:54.255ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7ae9acb3-cb41-4a20-a90f-536f1299f172/crucible/regions/a72e1deb-1dab-496e-a496-1cff7177863c", "c0dd9fd2-361b-40bc-8bb5-b6360bcb058f"]
512026-04-14T13:53:54.261ZINFOcrucible-agent (dropshot): request completed latency_us = 20706 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33733 req_id = 69c91b70-e043-43a7-8e3e-aab1379febf7 response_code = 200 uri = /crucible/0/regions/a72e1deb-1dab-496e-a496-1cff7177863c/snapshots/c0dd9fd2-361b-40bc-8bb5-b6360bcb058f/run