Max level shown:
1 [ Aug 2 17:23:17 Enabled. ]
2 [ Aug 2 17:23:17 Rereading configuration. ]
3 [ Aug 2 17:23:19 Rereading configuration. ]
4 [ Aug 2 17:23:20 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-02T17:23:20.591ZINFOcrucible-agent: dataset: "oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible"
72024-08-02T17:23:20.593ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-08-02T17:23:20.593ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-02T17:23:20.613ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-02T17:23:20.870ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-08-02T17:23:39.774ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:59063
122024-08-02T17:23:39.775ZINFOcrucible-agent (datafile): region 21697905-55f4-4652-af74-cf49c4b3a166 state: Requested
132024-08-02T17:23:39.776ZINFOcrucible-agent (dropshot): request completed latency_us = 645 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59063 req_id = 9462ae6c-ab5c-4305-9fc0-9e71dbd51bb5 response_code = 200 uri = /crucible/0/regions
142024-08-02T17:23:39.776ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-08-02T17:23:39.787ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible/regions/21697905-55f4-4652-af74-cf49c4b3a166
162024-08-02T17:23:39.787ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible/regions/21697905-55f4-4652-af74-cf49c4b3a166
172024-08-02T17:23:39.845ZINFOcrucible-agent (worker): creating region Region { id: RegionId("21697905-55f4-4652-af74-cf49c4b3a166"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/21697905-55f4-4652-af74-cf49c4b3a166" region = 21697905-55f4-4652-af74-cf49c4b3a166
182024-08-02T17:23:39.847ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "21697905-55f4-4652-af74-cf49c4b3a166" "--data" "/data/regions/21697905-55f4-4652-af74-cf49c4b3a166" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 21697905-55f4-4652-af74-cf49c4b3a166
192024-08-02T17:23:39.998ZINFOcrucible-agent (worker): region files created ok region = 21697905-55f4-4652-af74-cf49c4b3a166
202024-08-02T17:23:39.998ZINFOcrucible-agent (datafile): region 21697905-55f4-4652-af74-cf49c4b3a166 state: Requested -> Created
212024-08-02T17:23:39.998ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-08-02T17:23:39.999ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-21697905-55f4-4652-af74-cf49c4b3a166
232024-08-02T17:23:40.003ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-21697905-55f4-4652-af74-cf49c4b3a166
242024-08-02T17:23:40.013ZINFOcrucible-agent (worker): creating config property group
252024-08-02T17:23:40.016ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-21697905-55f4-4652-af74-cf49c4b3a166
262024-08-02T17:23:40.017ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/21697905-55f4-4652-af74-cf49c4b3a166
272024-08-02T17:23:40.017ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-08-02T17:23:40.017ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
292024-08-02T17:23:40.017ZINFOcrucible-agent (worker): commit
302024-08-02T17:23:40.024ZINFOcrucible-agent (worker): ok!
312024-08-02T17:23:40.030ZINFOcrucible-agent (worker): SMF ok!
322024-08-02T17:23:40.137ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59063 req_id = 65a55d33-c751-4a81-8b29-5aaf205ee6e7 response_code = 200 uri = /crucible/0/regions
332024-08-02T17:28:50.492ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:41077
342024-08-02T17:28:50.492ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41077 req_id = 137242a5-a25e-4980-89fb-7d283b29111f response_code = 200 uri = /crucible/0/regions/21697905-55f4-4652-af74-cf49c4b3a166
352024-08-02T17:28:50.497ZINFOcrucible-agent (datafile): path is "/data/regions/21697905-55f4-4652-af74-cf49c4b3a166"
362024-08-02T17:28:50.505ZINFOcrucible-agent (datafile): dataset is oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible/regions/21697905-55f4-4652-af74-cf49c4b3a166
372024-08-02T17:28:50.514ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible/regions/21697905-55f4-4652-af74-cf49c4b3a166@4902fb3a-b3e5-4cfd-8a5d-36861677a655
382024-08-02T17:28:50.514ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible/regions/21697905-55f4-4652-af74-cf49c4b3a166", "4902fb3a-b3e5-4cfd-8a5d-36861677a655"]
392024-08-02T17:28:50.525ZINFOcrucible-agent (dropshot): request completed latency_us = 32759 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41077 req_id = 29796bb5-79b1-40ff-a5a0-79154f350ac2 response_code = 200 uri = /crucible/0/regions/21697905-55f4-4652-af74-cf49c4b3a166/snapshots/4902fb3a-b3e5-4cfd-8a5d-36861677a655
402024-08-02T17:28:50.525ZINFOcrucible-agent (datafile): path is "/data/regions/21697905-55f4-4652-af74-cf49c4b3a166"
412024-08-02T17:28:50.532ZINFOcrucible-agent (datafile): dataset is oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible/regions/21697905-55f4-4652-af74-cf49c4b3a166
422024-08-02T17:28:50.541ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible/regions/21697905-55f4-4652-af74-cf49c4b3a166@4902fb3a-b3e5-4cfd-8a5d-36861677a655
432024-08-02T17:28:50.541ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_90c8a05e-fcad-497a-890c-a9f6819a18b4/crucible/regions/21697905-55f4-4652-af74-cf49c4b3a166", "4902fb3a-b3e5-4cfd-8a5d-36861677a655"]
442024-08-02T17:28:50.549ZINFOcrucible-agent (datafile): requesting running snapshot 21697905-55f4-4652-af74-cf49c4b3a166-4902fb3a-b3e5-4cfd-8a5d-36861677a655 state: Requested
452024-08-02T17:28:50.550ZINFOcrucible-agent (worker): applying SMF actions for region 21697905-55f4-4652-af74-cf49c4b3a166 running snapshot 4902fb3a-b3e5-4cfd-8a5d-36861677a655 (state Requested)...
462024-08-02T17:28:50.550ZINFOcrucible-agent (dropshot): request completed latency_us = 24918 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41077 req_id = 14d00312-4945-4e46-969f-4be5f887e290 response_code = 200 uri = /crucible/0/regions/21697905-55f4-4652-af74-cf49c4b3a166/snapshots/4902fb3a-b3e5-4cfd-8a5d-36861677a655/run
472024-08-02T17:28:50.556ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-21697905-55f4-4652-af74-cf49c4b3a166-4902fb3a-b3e5-4cfd-8a5d-36861677a655
482024-08-02T17:28:50.569ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-21697905-55f4-4652-af74-cf49c4b3a166-4902fb3a-b3e5-4cfd-8a5d-36861677a655
492024-08-02T17:28:50.590ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-21697905-55f4-4652-af74-cf49c4b3a166-4902fb3a-b3e5-4cfd-8a5d-36861677a655
502024-08-02T17:28:50.590ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/21697905-55f4-4652-af74-cf49c4b3a166/.zfs/snapshot/4902fb3a-b3e5-4cfd-8a5d-36861677a655
512024-08-02T17:28:50.590ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
522024-08-02T17:28:50.590ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
532024-08-02T17:28:50.590ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
542024-08-02T17:28:50.590ZINFOcrucible-agent (worker): commit
552024-08-02T17:28:50.597ZINFOcrucible-agent (worker): ok!
562024-08-02T17:28:50.606ZINFOcrucible-agent (worker): SMF ok!
572024-08-02T17:28:50.606ZINFOcrucible-agent (datafile): region 21697905-55f4-4652-af74-cf49c4b3a166 running snapshot 4902fb3a-b3e5-4cfd-8a5d-36861677a655 state: Requested -> Created