Max level shown:
1 [ Mar 26 14:48:04 Enabled. ]
2 [ Mar 26 14:48:04 Rereading configuration. ]
3 [ Mar 26 14:48:06 Rereading configuration. ]
4 [ Mar 26 14:48:09 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-26T14:48:09.468ZINFOcrucible-agent: dataset: "oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"
72024-03-26T14:48:09.474ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-03-26T14:48:09.474ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-26T14:48:09.687ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
102024-03-26T14:49:21.492ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:33618
112024-03-26T14:49:21.568ZINFOcrucible-agent (datafile): region 2aec97d6-6df5-4b49-adb8-fccbda22bcbc state: Requested
122024-03-26T14:49:21.570ZINFOcrucible-agent (dropshot): request completed latency_us = 16652 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33618 req_id = 931a14a5-5329-4e40-bf7a-ed4e24c02cf4 response_code = 200 uri = /crucible/0/regions
132024-03-26T14:49:21.571ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-03-26T14:49:21.581ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc
152024-03-26T14:49:21.581ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc
162024-03-26T14:49:21.631ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2aec97d6-6df5-4b49-adb8-fccbda22bcbc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc" region = 2aec97d6-6df5-4b49-adb8-fccbda22bcbc
172024-03-26T14:49:21.767ZINFOcrucible-agent (worker): region files created ok region = 2aec97d6-6df5-4b49-adb8-fccbda22bcbc
182024-03-26T14:49:21.767ZINFOcrucible-agent (datafile): region 2aec97d6-6df5-4b49-adb8-fccbda22bcbc state: Requested -> Created
192024-03-26T14:49:21.767ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-03-26T14:49:21.768ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2aec97d6-6df5-4b49-adb8-fccbda22bcbc
212024-03-26T14:49:21.773ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2aec97d6-6df5-4b49-adb8-fccbda22bcbc
222024-03-26T14:49:21.788ZINFOcrucible-agent (worker): creating config property group
232024-03-26T14:49:21.791ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2aec97d6-6df5-4b49-adb8-fccbda22bcbc
242024-03-26T14:49:21.792ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc
252024-03-26T14:49:21.794ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-03-26T14:49:21.794ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
272024-03-26T14:49:21.794ZINFOcrucible-agent (worker): commit
282024-03-26T14:49:21.803ZINFOcrucible-agent (worker): ok!
292024-03-26T14:49:21.810ZINFOcrucible-agent (worker): SMF ok!
302024-03-26T14:49:21.924ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33618 req_id = 960c1f7c-f88c-4981-8f46-000b01c5706b response_code = 200 uri = /crucible/0/regions
312024-03-26T14:54:43.479ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:64714
322024-03-26T14:54:43.480ZINFOcrucible-agent (dropshot): request completed latency_us = 655 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64714 req_id = 6f77c421-6706-474f-b749-25d939e303cf response_code = 200 uri = /crucible/0/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc
332024-03-26T14:54:43.480ZINFOcrucible-agent (datafile): path is "/data/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc"
342024-03-26T14:54:43.490ZINFOcrucible-agent (datafile): dataset is oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc
352024-03-26T14:54:43.498ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc@fa5b47a9-c836-4362-adba-f1c6c82aaa70
362024-03-26T14:54:43.498ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc", "fa5b47a9-c836-4362-adba-f1c6c82aaa70"]
372024-03-26T14:54:43.513ZINFOcrucible-agent (dropshot): request completed latency_us = 33430 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64714 req_id = 006cce3d-8639-46db-853e-c8abcbaf140e response_code = 200 uri = /crucible/0/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc/snapshots/fa5b47a9-c836-4362-adba-f1c6c82aaa70
382024-03-26T14:54:43.514ZINFOcrucible-agent (datafile): path is "/data/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc"
392024-03-26T14:54:43.523ZINFOcrucible-agent (datafile): dataset is oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc
402024-03-26T14:54:43.531ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc@fa5b47a9-c836-4362-adba-f1c6c82aaa70
412024-03-26T14:54:43.531ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc", "fa5b47a9-c836-4362-adba-f1c6c82aaa70"]
422024-03-26T14:54:43.541ZINFOcrucible-agent (datafile): requesting running snapshot 2aec97d6-6df5-4b49-adb8-fccbda22bcbc-fa5b47a9-c836-4362-adba-f1c6c82aaa70 state: Requested
432024-03-26T14:54:43.542ZINFOcrucible-agent (worker): applying SMF actions for region 2aec97d6-6df5-4b49-adb8-fccbda22bcbc running snapshot fa5b47a9-c836-4362-adba-f1c6c82aaa70 (state Requested)...
442024-03-26T14:54:43.542ZINFOcrucible-agent (dropshot): request completed latency_us = 28318 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64714 req_id = e5d820de-b29c-43f5-b533-48c566fabe4e response_code = 200 uri = /crucible/0/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc/snapshots/fa5b47a9-c836-4362-adba-f1c6c82aaa70/run
452024-03-26T14:54:43.554ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc
462024-03-26T14:54:43.554ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
472024-03-26T14:54:43.554ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
482024-03-26T14:54:43.554ZINFOcrucible-agent (worker): reconfig required
492024-03-26T14:54:43.554ZINFOcrucible-agent (worker): using existing config property group
502024-03-26T14:54:43.554ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2aec97d6-6df5-4b49-adb8-fccbda22bcbc
512024-03-26T14:54:43.554ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc
522024-03-26T14:54:43.554ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532024-03-26T14:54:43.554ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
542024-03-26T14:54:43.554ZINFOcrucible-agent (worker): commit
552024-03-26T14:54:43.560ZINFOcrucible-agent (worker): ok!
562024-03-26T14:54:43.561ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-2aec97d6-6df5-4b49-adb8-fccbda22bcbc-fa5b47a9-c836-4362-adba-f1c6c82aaa70
572024-03-26T14:54:43.564ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-2aec97d6-6df5-4b49-adb8-fccbda22bcbc-fa5b47a9-c836-4362-adba-f1c6c82aaa70
582024-03-26T14:54:43.576ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-2aec97d6-6df5-4b49-adb8-fccbda22bcbc-fa5b47a9-c836-4362-adba-f1c6c82aaa70
592024-03-26T14:54:43.576ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2aec97d6-6df5-4b49-adb8-fccbda22bcbc/.zfs/snapshot/fa5b47a9-c836-4362-adba-f1c6c82aaa70
602024-03-26T14:54:43.576ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
612024-03-26T14:54:43.576ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
622024-03-26T14:54:43.576ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
632024-03-26T14:54:43.576ZINFOcrucible-agent (worker): commit
642024-03-26T14:54:43.581ZINFOcrucible-agent (worker): ok!
652024-03-26T14:54:43.585ZINFOcrucible-agent (worker): SMF ok!
662024-03-26T14:54:43.585ZINFOcrucible-agent (datafile): region 2aec97d6-6df5-4b49-adb8-fccbda22bcbc running snapshot fa5b47a9-c836-4362-adba-f1c6c82aaa70 state: Requested -> Created