Max level shown:
1 [ Feb 21 06:52:13 Enabled. ]
2 [ Feb 21 06:52:13 Rereading configuration. ]
3 [ Feb 21 06:52:18 Rereading configuration. ]
4 [ Feb 21 06:52:27 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_5800a81d-6373-46e1-9b34-8e6c3ba894db/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-02-21T06:52:27.752ZINFOcrucible-agent: dataset: "oxp_5800a81d-6373-46e1-9b34-8e6c3ba894db/crucible"
72025-02-21T06:52:27.755ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82025-02-21T06:52:27.755ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-02-21T06:52:27.773ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-02-21T06:52:27.944ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112025-02-21T06:53:19.880ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:46409
122025-02-21T06:53:19.908ZINFOcrucible-agent (datafile): region a357cbb6-cd20-4e60-970e-fe2f08d74fbf state: Requested
132025-02-21T06:53:19.908ZINFOcrucible-agent (dropshot): request completed latency_us = 8733 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46409 req_id = 8784bc76-143e-42c8-8fcb-3c1383a7613c response_code = 200 uri = /crucible/0/regions
142025-02-21T06:53:19.911ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-02-21T06:53:19.919ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_5800a81d-6373-46e1-9b34-8e6c3ba894db/crucible/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
162025-02-21T06:53:19.919ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_5800a81d-6373-46e1-9b34-8e6c3ba894db/crucible/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
172025-02-21T06:53:20.105ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a357cbb6-cd20-4e60-970e-fe2f08d74fbf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf" region = a357cbb6-cd20-4e60-970e-fe2f08d74fbf
182025-02-21T06:53:20.107ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a357cbb6-cd20-4e60-970e-fe2f08d74fbf" "--data" "/data/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = a357cbb6-cd20-4e60-970e-fe2f08d74fbf
192025-02-21T06:53:20.145ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46409 req_id = 476317e4-c46f-4f9f-95ce-bdf18519ef7b response_code = 200 uri = /crucible/0/regions
202025-02-21T06:53:20.468ZINFOcrucible-agent (worker): region files created ok region = a357cbb6-cd20-4e60-970e-fe2f08d74fbf
212025-02-21T06:53:20.468ZINFOcrucible-agent (datafile): region a357cbb6-cd20-4e60-970e-fe2f08d74fbf state: Requested -> Created
222025-02-21T06:53:20.468ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-02-21T06:53:20.468ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a357cbb6-cd20-4e60-970e-fe2f08d74fbf
242025-02-21T06:53:20.488ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a357cbb6-cd20-4e60-970e-fe2f08d74fbf
252025-02-21T06:53:20.556ZINFOcrucible-agent (worker): creating config property group
262025-02-21T06:53:20.570ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a357cbb6-cd20-4e60-970e-fe2f08d74fbf
272025-02-21T06:53:20.571ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
282025-02-21T06:53:20.573ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-02-21T06:53:20.573ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302025-02-21T06:53:20.573ZINFOcrucible-agent (worker): commit
312025-02-21T06:53:20.585ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46409 req_id = 6f6c05d3-3184-4b3e-865c-cf1fde01e86f response_code = 200 uri = /crucible/0/regions
322025-02-21T06:53:20.627ZINFOcrucible-agent (worker): ok!
332025-02-21T06:53:20.667ZINFOcrucible-agent (worker): SMF ok!
342025-02-21T06:53:23.669ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46409 req_id = 1228aefe-c4e8-47d9-8725-4e514b892903 response_code = 200 uri = /crucible/0/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
352025-02-21T06:53:23.672ZINFOcrucible-agent (datafile): path is "/data/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf"
362025-02-21T06:53:23.683ZINFOcrucible-agent (datafile): dataset is oxp_5800a81d-6373-46e1-9b34-8e6c3ba894db/crucible/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
372025-02-21T06:53:23.692ZINFOcrucible-agent (datafile): region a357cbb6-cd20-4e60-970e-fe2f08d74fbf state: Created -> Tombstoned
382025-02-21T06:53:23.692ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-02-21T06:53:23.694ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-a357cbb6-cd20-4e60-970e-fe2f08d74fbf (instance states: (Some(Online), None))
402025-02-21T06:53:23.695ZINFOcrucible-agent (dropshot): request completed latency_us = 22909 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:46409 req_id = 3e044fb8-5703-4bbc-86e9-90eadd82294b response_code = 204 uri = /crucible/0/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
412025-02-21T06:53:23.698ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46409 req_id = 524ba587-ef96-444d-86f0-a246f08eb757 response_code = 200 uri = /crucible/0/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
422025-02-21T06:53:23.717ZINFOcrucible-agent (worker): SMF ok!
432025-02-21T06:53:23.730ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_5800a81d-6373-46e1-9b34-8e6c3ba894db/crucible/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf" region = a357cbb6-cd20-4e60-970e-fe2f08d74fbf
442025-02-21T06:53:23.789ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46409 req_id = 4e912ec2-cdf3-4c4c-9f17-92da44da81dc response_code = 200 uri = /crucible/0/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
452025-02-21T06:53:23.937ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46409 req_id = 57eee12c-145d-4f17-bdd5-c22615178096 response_code = 200 uri = /crucible/0/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf
462025-02-21T06:53:23.964ZINFOcrucible-agent (datafile): region a357cbb6-cd20-4e60-970e-fe2f08d74fbf state: Tombstoned -> Destroyed
472025-02-21T06:53:24.055ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46409 req_id = d1cee039-6e98-4cf7-a65f-7d0e98bc84f3 response_code = 200 uri = /crucible/0/regions/a357cbb6-cd20-4e60-970e-fe2f08d74fbf