Max level shown:
1 [ Mar 1 23:17:33 Enabled. ]
2 [ Mar 1 23:17:33 Rereading configuration. ]
3 [ Mar 1 23:17:38 Rereading configuration. ]
4 [ Mar 1 23:17:43 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-01T23:17:43.971ZINFOcrucible-agent: dataset: "oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible"
72024-03-01T23:17:43.975ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-03-01T23:17:43.975ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-01T23:17:44.282ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
102024-03-01T23:19:07.414ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:54933
112024-03-01T23:19:07.480ZINFOcrucible-agent (datafile): region 1136a670-e0c2-4677-a2a0-e27bf38aad53 state: Requested
122024-03-01T23:19:07.483ZINFOcrucible-agent (dropshot): request completed latency_us = 5757 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54933 req_id = 0744e906-babb-4b96-b237-04bfc8d4994e response_code = 200 uri = /crucible/0/regions
132024-03-01T23:19:07.483ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-03-01T23:19:07.495ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53
152024-03-01T23:19:07.495ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53
162024-03-01T23:19:07.546ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1136a670-e0c2-4677-a2a0-e27bf38aad53"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53" region = 1136a670-e0c2-4677-a2a0-e27bf38aad53
172024-03-01T23:19:07.620ZINFOcrucible-agent (dropshot): request completed latency_us = 562 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54933 req_id = 552f1238-d2ac-40a0-8e50-76ff7d3c7a4e response_code = 200 uri = /crucible/0/regions
182024-03-01T23:19:07.684ZINFOcrucible-agent (worker): region files created ok region = 1136a670-e0c2-4677-a2a0-e27bf38aad53
192024-03-01T23:19:07.684ZINFOcrucible-agent (datafile): region 1136a670-e0c2-4677-a2a0-e27bf38aad53 state: Requested -> Created
202024-03-01T23:19:07.684ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-03-01T23:19:07.685ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1136a670-e0c2-4677-a2a0-e27bf38aad53
222024-03-01T23:19:07.690ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1136a670-e0c2-4677-a2a0-e27bf38aad53
232024-03-01T23:19:07.700ZINFOcrucible-agent (worker): creating config property group
242024-03-01T23:19:07.704ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1136a670-e0c2-4677-a2a0-e27bf38aad53
252024-03-01T23:19:07.705ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53
262024-03-01T23:19:07.705ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-03-01T23:19:07.705ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
282024-03-01T23:19:07.705ZINFOcrucible-agent (worker): commit
292024-03-01T23:19:07.708ZINFOcrucible-agent (worker): ok!
302024-03-01T23:19:07.713ZINFOcrucible-agent (worker): SMF ok!
312024-03-01T23:19:07.985ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54933 req_id = 47e8c853-51af-49bb-8688-d66d91f3eb1f response_code = 200 uri = /crucible/0/regions
322024-03-01T23:24:31.097ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:54576
332024-03-01T23:24:31.101ZINFOcrucible-agent (dropshot): request completed latency_us = 3643 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54576 req_id = 80510b78-3bed-4788-9080-0bd01c181473 response_code = 200 uri = /crucible/0/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53
342024-03-01T23:24:31.104ZINFOcrucible-agent (datafile): path is "/data/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53"
352024-03-01T23:24:31.113ZINFOcrucible-agent (datafile): dataset is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53
362024-03-01T23:24:31.122ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53@8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0
372024-03-01T23:24:31.122ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53", "8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0"]
382024-03-01T23:24:31.138ZINFOcrucible-agent (dropshot): request completed latency_us = 34405 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54576 req_id = c6508b12-2057-46c1-a05f-ba9b91f9a82f response_code = 200 uri = /crucible/0/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53/snapshots/8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0
392024-03-01T23:24:31.141ZINFOcrucible-agent (datafile): path is "/data/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53"
402024-03-01T23:24:31.150ZINFOcrucible-agent (datafile): dataset is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53
412024-03-01T23:24:31.157ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53@8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0
422024-03-01T23:24:31.157ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53", "8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0"]
432024-03-01T23:24:31.174ZINFOcrucible-agent (datafile): requesting running snapshot 1136a670-e0c2-4677-a2a0-e27bf38aad53-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0 state: Requested
442024-03-01T23:24:31.174ZINFOcrucible-agent (worker): applying SMF actions for region 1136a670-e0c2-4677-a2a0-e27bf38aad53 running snapshot 8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0 (state Requested)...
452024-03-01T23:24:31.174ZINFOcrucible-agent (dropshot): request completed latency_us = 33866 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54576 req_id = 50b4399c-8a95-417b-918e-862d06a401af response_code = 200 uri = /crucible/0/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53/snapshots/8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0/run
462024-03-01T23:24:31.181ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-1136a670-e0c2-4677-a2a0-e27bf38aad53-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0
472024-03-01T23:24:31.193ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-1136a670-e0c2-4677-a2a0-e27bf38aad53-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0
482024-03-01T23:24:31.224ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-1136a670-e0c2-4677-a2a0-e27bf38aad53-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0
492024-03-01T23:24:31.225ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1136a670-e0c2-4677-a2a0-e27bf38aad53/.zfs/snapshot/8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0
502024-03-01T23:24:31.225ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512024-03-01T23:24:31.225ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
522024-03-01T23:24:31.225ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
532024-03-01T23:24:31.225ZINFOcrucible-agent (worker): commit
542024-03-01T23:24:31.240ZINFOcrucible-agent (worker): ok!
552024-03-01T23:24:31.256ZINFOcrucible-agent (worker): SMF ok!
562024-03-01T23:24:31.256ZINFOcrucible-agent (datafile): region 1136a670-e0c2-4677-a2a0-e27bf38aad53 running snapshot 8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0 state: Requested -> Created