Max level shown:
12025-12-24T05:24:05.897ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:39881
22025-12-24T05:24:05.897ZINFOcrucible-agent (datafile): region a153319d-fef4-4835-a64c-85d20ab49b5d state: Requested
32025-12-24T05:24:05.897ZINFOcrucible-agent (dropshot): request completed latency_us = 655 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39881 req_id = 6e0a42f5-abc8-46b1-bbe2-adb0fdca02b5 response_code = 200 uri = /crucible/0/regions
42025-12-24T05:24:05.897ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-24T05:24:05.906ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/a153319d-fef4-4835-a64c-85d20ab49b5d
62025-12-24T05:24:05.906ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/a153319d-fef4-4835-a64c-85d20ab49b5d
72025-12-24T05:24:05.963ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a153319d-fef4-4835-a64c-85d20ab49b5d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a153319d-fef4-4835-a64c-85d20ab49b5d" region = a153319d-fef4-4835-a64c-85d20ab49b5d
82025-12-24T05:24:05.963ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a153319d-fef4-4835-a64c-85d20ab49b5d" "--data" "/data/regions/a153319d-fef4-4835-a64c-85d20ab49b5d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a153319d-fef4-4835-a64c-85d20ab49b5d
92025-12-24T05:24:06.059ZINFOcrucible-agent (worker): region files created ok region = a153319d-fef4-4835-a64c-85d20ab49b5d
102025-12-24T05:24:06.059ZINFOcrucible-agent (datafile): region a153319d-fef4-4835-a64c-85d20ab49b5d state: Requested -> Created
112025-12-24T05:24:06.060ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-12-24T05:24:06.078ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a153319d-fef4-4835-a64c-85d20ab49b5d
132025-12-24T05:24:06.085ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a153319d-fef4-4835-a64c-85d20ab49b5d
142025-12-24T05:24:06.094ZINFOcrucible-agent (worker): creating config property group
152025-12-24T05:24:06.097ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a153319d-fef4-4835-a64c-85d20ab49b5d
162025-12-24T05:24:06.098ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a153319d-fef4-4835-a64c-85d20ab49b5d
172025-12-24T05:24:06.098ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-12-24T05:24:06.098ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192025-12-24T05:24:06.098ZINFOcrucible-agent (worker): commit
202025-12-24T05:24:06.101ZINFOcrucible-agent (worker): ok!
212025-12-24T05:24:06.106ZINFOcrucible-agent (worker): SMF ok!
222025-12-24T05:24:06.219ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39881 req_id = c0e6e764-8413-4411-9c1e-073959cca79a response_code = 200 uri = /crucible/0/regions
232025-12-24T05:24:07.221ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39881 req_id = 9b413f76-b50d-4a9d-9132-b8b0216675cf response_code = 200 uri = /crucible/0/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf
242025-12-24T05:24:07.226ZINFOcrucible-agent (datafile): path is "/data/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf"
252025-12-24T05:24:07.233ZINFOcrucible-agent (datafile): dataset is oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf
262025-12-24T05:24:07.239ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf@9b8beae9-e529-48e1-9706-48dc272f2c55
272025-12-24T05:24:07.239ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf", "9b8beae9-e529-48e1-9706-48dc272f2c55"]
282025-12-24T05:24:07.247ZINFOcrucible-agent (dropshot): request completed latency_us = 20822 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39881 req_id = 99673d20-24ec-4df7-83fe-c2a8c2ac7e15 response_code = 200 uri = /crucible/0/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf/snapshots/9b8beae9-e529-48e1-9706-48dc272f2c55
292025-12-24T05:24:07.252ZINFOcrucible-agent (datafile): path is "/data/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf"
302025-12-24T05:24:07.257ZINFOcrucible-agent (datafile): dataset is oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf
312025-12-24T05:24:07.263ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf@9b8beae9-e529-48e1-9706-48dc272f2c55
322025-12-24T05:24:07.263ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf", "9b8beae9-e529-48e1-9706-48dc272f2c55"]
332025-12-24T05:24:07.271ZINFOcrucible-agent (datafile): requesting running snapshot 79ecafc5-a691-4e0d-9f3c-99512c049fdf-9b8beae9-e529-48e1-9706-48dc272f2c55 state: Requested
342025-12-24T05:24:07.271ZINFOcrucible-agent (dropshot): request completed latency_us = 19004 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39881 req_id = c767054a-8db6-48da-85db-94f084c7a616 response_code = 200 uri = /crucible/0/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf/snapshots/9b8beae9-e529-48e1-9706-48dc272f2c55/run
352025-12-24T05:24:07.271ZINFOcrucible-agent (worker): applying SMF actions for region 79ecafc5-a691-4e0d-9f3c-99512c049fdf running snapshot 9b8beae9-e529-48e1-9706-48dc272f2c55 (state Requested)...
362025-12-24T05:24:07.275ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-79ecafc5-a691-4e0d-9f3c-99512c049fdf-9b8beae9-e529-48e1-9706-48dc272f2c55
372025-12-24T05:24:07.283ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-79ecafc5-a691-4e0d-9f3c-99512c049fdf-9b8beae9-e529-48e1-9706-48dc272f2c55
382025-12-24T05:24:07.293ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-79ecafc5-a691-4e0d-9f3c-99512c049fdf-9b8beae9-e529-48e1-9706-48dc272f2c55
392025-12-24T05:24:07.293ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf/.zfs/snapshot/9b8beae9-e529-48e1-9706-48dc272f2c55
402025-12-24T05:24:07.293ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-12-24T05:24:07.293ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-12-24T05:24:07.293ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432025-12-24T05:24:07.293ZINFOcrucible-agent (worker): commit
442025-12-24T05:24:07.297ZINFOcrucible-agent (worker): ok!
452025-12-24T05:24:07.301ZINFOcrucible-agent (worker): SMF ok!
462025-12-24T05:24:07.301ZINFOcrucible-agent (datafile): region 79ecafc5-a691-4e0d-9f3c-99512c049fdf running snapshot 9b8beae9-e529-48e1-9706-48dc272f2c55 state: Requested -> Created
472025-12-24T05:24:07.460ZINFOcrucible-agent (datafile): path is "/data/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf"
482025-12-24T05:24:07.465ZINFOcrucible-agent (datafile): dataset is oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf
492025-12-24T05:24:07.470ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf@9b8beae9-e529-48e1-9706-48dc272f2c55
502025-12-24T05:24:07.470ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f49d5a8c-6620-435a-96f2-7b712361aab6/crucible/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf", "9b8beae9-e529-48e1-9706-48dc272f2c55"]
512025-12-24T05:24:07.477ZINFOcrucible-agent (dropshot): request completed latency_us = 17076 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39881 req_id = 76a3046e-44b2-4708-9e76-85a3115889f7 response_code = 200 uri = /crucible/0/regions/79ecafc5-a691-4e0d-9f3c-99512c049fdf/snapshots/9b8beae9-e529-48e1-9706-48dc272f2c55/run