Max level shown:
12025-11-05T23:30:06.078ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:40358
22025-11-05T23:30:06.107ZINFOcrucible-agent (datafile): region 55b66812-7a06-42a9-a129-9d5fb37d6dfd state: Requested
32025-11-05T23:30:06.110ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-11-05T23:30:06.110ZINFOcrucible-agent (dropshot): request completed latency_us = 17286 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40358 req_id = 47bd1ce1-dcba-440f-8aec-b7b807425366 response_code = 200 uri = /crucible/0/regions
52025-11-05T23:30:06.119ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd
62025-11-05T23:30:06.119ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd
72025-11-05T23:30:06.216ZINFOcrucible-agent (worker): creating region Region { id: RegionId("55b66812-7a06-42a9-a129-9d5fb37d6dfd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd" region = 55b66812-7a06-42a9-a129-9d5fb37d6dfd
82025-11-05T23:30:06.217ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "55b66812-7a06-42a9-a129-9d5fb37d6dfd" "--data" "/data/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 55b66812-7a06-42a9-a129-9d5fb37d6dfd
92025-11-05T23:30:06.463ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40358 req_id = f8700940-7141-4312-a17d-1b4e5853c9dd response_code = 200 uri = /crucible/0/regions
102025-11-05T23:30:06.650ZINFOcrucible-agent (worker): region files created ok region = 55b66812-7a06-42a9-a129-9d5fb37d6dfd
112025-11-05T23:30:06.650ZINFOcrucible-agent (datafile): region 55b66812-7a06-42a9-a129-9d5fb37d6dfd state: Requested -> Created
122025-11-05T23:30:06.650ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-11-05T23:30:06.651ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-55b66812-7a06-42a9-a129-9d5fb37d6dfd
142025-11-05T23:30:06.658ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-55b66812-7a06-42a9-a129-9d5fb37d6dfd
152025-11-05T23:30:06.681ZINFOcrucible-agent (worker): creating config property group
162025-11-05T23:30:06.688ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-55b66812-7a06-42a9-a129-9d5fb37d6dfd
172025-11-05T23:30:06.688ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd
182025-11-05T23:30:06.688ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-11-05T23:30:06.688ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202025-11-05T23:30:06.688ZINFOcrucible-agent (worker): commit
212025-11-05T23:30:06.697ZINFOcrucible-agent (worker): ok!
222025-11-05T23:30:06.705ZINFOcrucible-agent (worker): SMF ok!
232025-11-05T23:30:06.933ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40358 req_id = 68a6637b-6873-4136-994a-9e2ef67c1155 response_code = 200 uri = /crucible/0/regions
242025-11-05T23:40:36.484ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:55826
252025-11-05T23:40:36.488ZINFOcrucible-agent (dropshot): request completed latency_us = 3131 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55826 req_id = f761014c-62d8-4432-a573-e5864ad774c5 response_code = 200 uri = /crucible/0/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd
262025-11-05T23:40:36.493ZINFOcrucible-agent (datafile): path is "/data/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd"
272025-11-05T23:40:36.500ZINFOcrucible-agent (datafile): dataset is oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd
282025-11-05T23:40:36.507ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd@1eca01dc-d31c-4c80-b454-d1dba61be18c
292025-11-05T23:40:36.507ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd", "1eca01dc-d31c-4c80-b454-d1dba61be18c"]
302025-11-05T23:40:36.517ZINFOcrucible-agent (dropshot): request completed latency_us = 23541 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55826 req_id = 4cdbc72f-b492-4b10-96f1-271af110e539 response_code = 200 uri = /crucible/0/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd/snapshots/1eca01dc-d31c-4c80-b454-d1dba61be18c
312025-11-05T23:40:36.525ZINFOcrucible-agent (datafile): path is "/data/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd"
322025-11-05T23:40:36.531ZINFOcrucible-agent (datafile): dataset is oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd
332025-11-05T23:40:36.537ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd@1eca01dc-d31c-4c80-b454-d1dba61be18c
342025-11-05T23:40:36.537ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd", "1eca01dc-d31c-4c80-b454-d1dba61be18c"]
352025-11-05T23:40:36.545ZINFOcrucible-agent (datafile): requesting running snapshot 55b66812-7a06-42a9-a129-9d5fb37d6dfd-1eca01dc-d31c-4c80-b454-d1dba61be18c state: Requested
362025-11-05T23:40:36.546ZINFOcrucible-agent (worker): applying SMF actions for region 55b66812-7a06-42a9-a129-9d5fb37d6dfd running snapshot 1eca01dc-d31c-4c80-b454-d1dba61be18c (state Requested)...
372025-11-05T23:40:36.546ZINFOcrucible-agent (dropshot): request completed latency_us = 20635 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55826 req_id = 8eabd704-921a-4e0f-bffe-f7b3531825fd response_code = 200 uri = /crucible/0/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd/snapshots/1eca01dc-d31c-4c80-b454-d1dba61be18c/run
382025-11-05T23:40:36.563ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-55b66812-7a06-42a9-a129-9d5fb37d6dfd-1eca01dc-d31c-4c80-b454-d1dba61be18c
392025-11-05T23:40:36.575ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-55b66812-7a06-42a9-a129-9d5fb37d6dfd-1eca01dc-d31c-4c80-b454-d1dba61be18c
402025-11-05T23:40:36.587ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-55b66812-7a06-42a9-a129-9d5fb37d6dfd-1eca01dc-d31c-4c80-b454-d1dba61be18c
412025-11-05T23:40:36.587ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd/.zfs/snapshot/1eca01dc-d31c-4c80-b454-d1dba61be18c
422025-11-05T23:40:36.587ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432025-11-05T23:40:36.587ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442025-11-05T23:40:36.587ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
452025-11-05T23:40:36.587ZINFOcrucible-agent (worker): commit
462025-11-05T23:40:36.590ZINFOcrucible-agent (worker): ok!
472025-11-05T23:40:36.594ZINFOcrucible-agent (worker): SMF ok!
482025-11-05T23:40:36.595ZINFOcrucible-agent (datafile): region 55b66812-7a06-42a9-a129-9d5fb37d6dfd running snapshot 1eca01dc-d31c-4c80-b454-d1dba61be18c state: Requested -> Created
492025-11-05T23:40:36.819ZINFOcrucible-agent (datafile): path is "/data/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd"
502025-11-05T23:40:36.825ZINFOcrucible-agent (datafile): dataset is oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd
512025-11-05T23:40:36.832ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd@1eca01dc-d31c-4c80-b454-d1dba61be18c
522025-11-05T23:40:36.832ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b36463fd-48be-4db4-9552-dcf6e44f59dc/crucible/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd", "1eca01dc-d31c-4c80-b454-d1dba61be18c"]
532025-11-05T23:40:36.838ZINFOcrucible-agent (dropshot): request completed latency_us = 19269 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55826 req_id = 5877cd6d-10c5-42e6-b661-dc382550ba93 response_code = 200 uri = /crucible/0/regions/55b66812-7a06-42a9-a129-9d5fb37d6dfd/snapshots/1eca01dc-d31c-4c80-b454-d1dba61be18c/run