Max level shown:
1 [ Feb 28 13:20:41 Enabled. ]
2 [ Feb 28 13:20:41 Rereading configuration. ]
3 [ Feb 28 13:20:43 Rereading configuration. ]
4 [ Feb 28 13:20:46 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-02-28T13:20:46.898ZINFOcrucible-agent: dataset: "oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible"
72024-02-28T13:20:46.899ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-02-28T13:20:46.899ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-02-28T13:20:47.063ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
102024-02-28T13:22:08.392ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:37102
112024-02-28T13:22:08.453ZINFOcrucible-agent (datafile): region e21e29f0-a653-4424-b3c9-9c42c31fe20b state: Requested
122024-02-28T13:22:08.453ZINFOcrucible-agent (dropshot): request completed latency_us = 1603 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37102 req_id = 2560f457-b18f-4ac8-82d5-bc2be005b1a9 response_code = 200 uri = /crucible/0/regions
132024-02-28T13:22:08.454ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-02-28T13:22:08.464ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b
152024-02-28T13:22:08.464ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b
162024-02-28T13:22:08.517ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e21e29f0-a653-4424-b3c9-9c42c31fe20b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b" region = e21e29f0-a653-4424-b3c9-9c42c31fe20b
172024-02-28T13:22:08.686ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37102 req_id = c0feef56-e1c8-48cb-b2b9-bacae5e4dba9 response_code = 200 uri = /crucible/0/regions
182024-02-28T13:22:08.699ZINFOcrucible-agent (worker): region files created ok region = e21e29f0-a653-4424-b3c9-9c42c31fe20b
192024-02-28T13:22:08.699ZINFOcrucible-agent (datafile): region e21e29f0-a653-4424-b3c9-9c42c31fe20b state: Requested -> Created
202024-02-28T13:22:08.699ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-02-28T13:22:08.699ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e21e29f0-a653-4424-b3c9-9c42c31fe20b
222024-02-28T13:22:08.706ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e21e29f0-a653-4424-b3c9-9c42c31fe20b
232024-02-28T13:22:08.728ZINFOcrucible-agent (worker): creating config property group
242024-02-28T13:22:08.734ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e21e29f0-a653-4424-b3c9-9c42c31fe20b
252024-02-28T13:22:08.735ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b
262024-02-28T13:22:08.735ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-02-28T13:22:08.735ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
282024-02-28T13:22:08.735ZINFOcrucible-agent (worker): commit
292024-02-28T13:22:08.740ZINFOcrucible-agent (worker): ok!
302024-02-28T13:22:08.747ZINFOcrucible-agent (worker): SMF ok!
312024-02-28T13:22:09.143ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37102 req_id = 194030da-dfbd-4c2a-9a3c-dbfacd26c856 response_code = 200 uri = /crucible/0/regions
322024-02-28T13:27:34.726ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:54522
332024-02-28T13:27:34.730ZINFOcrucible-agent (dropshot): request completed latency_us = 3682 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54522 req_id = 63fab5f0-3b9d-4abc-83cf-2343b6465bea response_code = 200 uri = /crucible/0/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b
342024-02-28T13:27:34.731ZINFOcrucible-agent (datafile): path is "/data/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b"
352024-02-28T13:27:34.744ZINFOcrucible-agent (datafile): dataset is oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b
362024-02-28T13:27:34.757ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b@3400d481-4e0c-4b23-99d9-4ea4d578de90
372024-02-28T13:27:34.757ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b", "3400d481-4e0c-4b23-99d9-4ea4d578de90"]
382024-02-28T13:27:34.774ZINFOcrucible-agent (dropshot): request completed latency_us = 43504 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54522 req_id = ea565449-c14b-464b-a06d-28669e7b6f82 response_code = 200 uri = /crucible/0/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b/snapshots/3400d481-4e0c-4b23-99d9-4ea4d578de90
392024-02-28T13:27:34.778ZINFOcrucible-agent (datafile): path is "/data/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b"
402024-02-28T13:27:34.790ZINFOcrucible-agent (datafile): dataset is oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b
412024-02-28T13:27:34.803ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b@3400d481-4e0c-4b23-99d9-4ea4d578de90
422024-02-28T13:27:34.803ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b", "3400d481-4e0c-4b23-99d9-4ea4d578de90"]
432024-02-28T13:27:34.815ZINFOcrucible-agent (datafile): requesting running snapshot e21e29f0-a653-4424-b3c9-9c42c31fe20b-3400d481-4e0c-4b23-99d9-4ea4d578de90 state: Requested
442024-02-28T13:27:34.816ZINFOcrucible-agent (worker): applying SMF actions for region e21e29f0-a653-4424-b3c9-9c42c31fe20b running snapshot 3400d481-4e0c-4b23-99d9-4ea4d578de90 (state Requested)...
452024-02-28T13:27:34.816ZINFOcrucible-agent (dropshot): request completed latency_us = 39228 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54522 req_id = 27d6d7fc-3eb4-4f27-acd7-590b388f2ae3 response_code = 200 uri = /crucible/0/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b/snapshots/3400d481-4e0c-4b23-99d9-4ea4d578de90/run
462024-02-28T13:27:34.824ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e21e29f0-a653-4424-b3c9-9c42c31fe20b-3400d481-4e0c-4b23-99d9-4ea4d578de90
472024-02-28T13:27:34.829ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e21e29f0-a653-4424-b3c9-9c42c31fe20b-3400d481-4e0c-4b23-99d9-4ea4d578de90
482024-02-28T13:27:34.843ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e21e29f0-a653-4424-b3c9-9c42c31fe20b-3400d481-4e0c-4b23-99d9-4ea4d578de90
492024-02-28T13:27:34.844ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e21e29f0-a653-4424-b3c9-9c42c31fe20b/.zfs/snapshot/3400d481-4e0c-4b23-99d9-4ea4d578de90
502024-02-28T13:27:34.844ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512024-02-28T13:27:34.844ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
522024-02-28T13:27:34.844ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
532024-02-28T13:27:34.844ZINFOcrucible-agent (worker): commit
542024-02-28T13:27:34.849ZINFOcrucible-agent (worker): ok!
552024-02-28T13:27:34.856ZINFOcrucible-agent (worker): SMF ok!
562024-02-28T13:27:34.856ZINFOcrucible-agent (datafile): region e21e29f0-a653-4424-b3c9-9c42c31fe20b running snapshot 3400d481-4e0c-4b23-99d9-4ea4d578de90 state: Requested -> Created