Max level shown:
1 [ May 30 21:26:00 Enabled. ]
2 [ May 30 21:26:00 Rereading configuration. ]
3 [ May 30 21:26:02 Rereading configuration. ]
4 [ May 30 21:26:06 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_54ee06c1-d9d7-4f19-b209-7f6a7beb2451/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-05-30T21:26:06.667ZINFOcrucible-agent: dataset: "oxp_54ee06c1-d9d7-4f19-b209-7f6a7beb2451/crucible"
72025-05-30T21:26:06.671ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82025-05-30T21:26:06.671ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-05-30T21:26:06.691ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-05-30T21:26:06.798ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
112025-05-30T21:26:26.237ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:41685
122025-05-30T21:26:26.267ZINFOcrucible-agent (datafile): region 2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8 state: Requested
132025-05-30T21:26:26.272ZINFOcrucible-agent (dropshot): request completed latency_us = 18621 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41685 req_id = 03210c77-47bc-423b-b91e-872a46177f95 response_code = 200 uri = /crucible/0/regions
142025-05-30T21:26:26.272ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-05-30T21:26:26.283ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_54ee06c1-d9d7-4f19-b209-7f6a7beb2451/crucible/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
162025-05-30T21:26:26.283ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_54ee06c1-d9d7-4f19-b209-7f6a7beb2451/crucible/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
172025-05-30T21:26:26.422ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8" region = 2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
182025-05-30T21:26:26.424ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8" "--data" "/data/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
192025-05-30T21:26:26.589ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41685 req_id = 91318da0-7c6b-44b7-bd2f-134c5d765286 response_code = 200 uri = /crucible/0/regions
202025-05-30T21:26:26.658ZINFOcrucible-agent (worker): region files created ok region = 2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
212025-05-30T21:26:26.658ZINFOcrucible-agent (datafile): region 2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8 state: Requested -> Created
222025-05-30T21:26:26.658ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-05-30T21:26:26.658ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
242025-05-30T21:26:26.675ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
252025-05-30T21:26:26.704ZINFOcrucible-agent (worker): creating config property group
262025-05-30T21:26:26.707ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
272025-05-30T21:26:26.707ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
282025-05-30T21:26:26.708ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-05-30T21:26:26.708ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
302025-05-30T21:26:26.708ZINFOcrucible-agent (worker): commit
312025-05-30T21:26:26.712ZINFOcrucible-agent (worker): ok!
322025-05-30T21:26:26.737ZINFOcrucible-agent (worker): SMF ok!
332025-05-30T21:26:26.983ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41685 req_id = fcecfb1d-76fd-46c1-ba39-88a96b1019f8 response_code = 200 uri = /crucible/0/regions
342025-05-30T21:26:27.601ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41685 req_id = 4396c382-b5ec-4e89-adef-4408ef47ace5 response_code = 200 uri = /crucible/0/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
352025-05-30T21:26:27.604ZINFOcrucible-agent (datafile): path is "/data/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8"
362025-05-30T21:26:27.615ZINFOcrucible-agent (datafile): dataset is oxp_54ee06c1-d9d7-4f19-b209-7f6a7beb2451/crucible/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
372025-05-30T21:26:27.626ZINFOcrucible-agent (datafile): region 2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8 state: Created -> Tombstoned
382025-05-30T21:26:27.626ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-05-30T21:26:27.626ZINFOcrucible-agent (dropshot): request completed latency_us = 21931 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:41685 req_id = 90503a0f-7dd2-42c8-9961-02317c62cefa response_code = 204 uri = /crucible/0/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
402025-05-30T21:26:27.627ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8 (instance states: (Some(Online), None))
412025-05-30T21:26:27.629ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41685 req_id = b70cfe88-054e-498d-8dc0-9bbdb56e3442 response_code = 200 uri = /crucible/0/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
422025-05-30T21:26:27.647ZINFOcrucible-agent (worker): SMF ok!
432025-05-30T21:26:27.659ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_54ee06c1-d9d7-4f19-b209-7f6a7beb2451/crucible/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8" region = 2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
442025-05-30T21:26:27.701ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41685 req_id = 031286cf-6506-4fe2-bb97-d78d29dfe435 response_code = 200 uri = /crucible/0/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
452025-05-30T21:26:27.798ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41685 req_id = 87dd14b4-c2c8-47d4-b85b-34b68d0c7ac7 response_code = 200 uri = /crucible/0/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8
462025-05-30T21:26:27.873ZINFOcrucible-agent (datafile): region 2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8 state: Tombstoned -> Destroyed
472025-05-30T21:26:27.878ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41685 req_id = 87181c8b-0c24-4368-9d6f-81630395e0cc response_code = 200 uri = /crucible/0/regions/2ca521d6-c9ee-45f9-a49f-1cec23c5f2a8