Max level shown:
1 [ Jul 31 06:52:31 Enabled. ]
2 [ Jul 31 06:52:31 Rereading configuration. ]
3 [ Jul 31 06:52:32 Rereading configuration. ]
4 [ Jul 31 06:52:33 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-31T06:52:34.022ZINFOcrucible-agent: dataset: "oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible"
72024-07-31T06:52:34.023ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-07-31T06:52:34.023ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-31T06:52:34.043ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-31T06:52:34.124ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112024-07-31T06:53:26.710ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:52673
122024-07-31T06:53:26.735ZINFOcrucible-agent (datafile): region 45425fc2-77d9-4eec-a417-dbc2daf39351 state: Requested
132024-07-31T06:53:26.741ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-07-31T06:53:26.741ZINFOcrucible-agent (dropshot): request completed latency_us = 15141 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52673 req_id = d59708ce-d0d1-45da-b678-ca5901222ca6 response_code = 200 uri = /crucible/0/regions
152024-07-31T06:53:26.752ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible/regions/45425fc2-77d9-4eec-a417-dbc2daf39351
162024-07-31T06:53:26.753ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible/regions/45425fc2-77d9-4eec-a417-dbc2daf39351
172024-07-31T06:53:26.801ZINFOcrucible-agent (worker): creating region Region { id: RegionId("45425fc2-77d9-4eec-a417-dbc2daf39351"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/45425fc2-77d9-4eec-a417-dbc2daf39351" region = 45425fc2-77d9-4eec-a417-dbc2daf39351
182024-07-31T06:53:26.803ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "45425fc2-77d9-4eec-a417-dbc2daf39351" "--data" "/data/regions/45425fc2-77d9-4eec-a417-dbc2daf39351" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 45425fc2-77d9-4eec-a417-dbc2daf39351
192024-07-31T06:53:26.972ZINFOcrucible-agent (worker): region files created ok region = 45425fc2-77d9-4eec-a417-dbc2daf39351
202024-07-31T06:53:26.972ZINFOcrucible-agent (datafile): region 45425fc2-77d9-4eec-a417-dbc2daf39351 state: Requested -> Created
212024-07-31T06:53:26.972ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-07-31T06:53:26.972ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-45425fc2-77d9-4eec-a417-dbc2daf39351
232024-07-31T06:53:26.976ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-45425fc2-77d9-4eec-a417-dbc2daf39351
242024-07-31T06:53:26.994ZINFOcrucible-agent (worker): creating config property group
252024-07-31T06:53:27.001ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-45425fc2-77d9-4eec-a417-dbc2daf39351
262024-07-31T06:53:27.004ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/45425fc2-77d9-4eec-a417-dbc2daf39351
272024-07-31T06:53:27.006ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-07-31T06:53:27.006ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
292024-07-31T06:53:27.006ZINFOcrucible-agent (worker): commit
302024-07-31T06:53:27.009ZINFOcrucible-agent (worker): ok!
312024-07-31T06:53:27.013ZINFOcrucible-agent (worker): SMF ok!
322024-07-31T06:53:27.048ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52673 req_id = 62f6154c-05d0-4d56-a8a2-63273cd93f9c response_code = 200 uri = /crucible/0/regions
332024-07-31T06:58:35.331ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:48795
342024-07-31T06:58:35.331ZINFOcrucible-agent (dropshot): request completed latency_us = 667 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48795 req_id = c5069e5d-0ea4-43e5-b81e-87aa7fd1f2c7 response_code = 200 uri = /crucible/0/regions/45425fc2-77d9-4eec-a417-dbc2daf39351
352024-07-31T06:58:35.335ZINFOcrucible-agent (datafile): path is "/data/regions/45425fc2-77d9-4eec-a417-dbc2daf39351"
362024-07-31T06:58:35.344ZINFOcrucible-agent (datafile): dataset is oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible/regions/45425fc2-77d9-4eec-a417-dbc2daf39351
372024-07-31T06:58:35.353ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible/regions/45425fc2-77d9-4eec-a417-dbc2daf39351@66282e51-1b54-4615-a46d-430ecdd87e5a
382024-07-31T06:58:35.353ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible/regions/45425fc2-77d9-4eec-a417-dbc2daf39351", "66282e51-1b54-4615-a46d-430ecdd87e5a"]
392024-07-31T06:58:35.365ZINFOcrucible-agent (dropshot): request completed latency_us = 33518 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48795 req_id = 432b52c4-1ca3-41ff-80c2-02276735b51a response_code = 200 uri = /crucible/0/regions/45425fc2-77d9-4eec-a417-dbc2daf39351/snapshots/66282e51-1b54-4615-a46d-430ecdd87e5a
402024-07-31T06:58:35.365ZINFOcrucible-agent (datafile): path is "/data/regions/45425fc2-77d9-4eec-a417-dbc2daf39351"
412024-07-31T06:58:35.374ZINFOcrucible-agent (datafile): dataset is oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible/regions/45425fc2-77d9-4eec-a417-dbc2daf39351
422024-07-31T06:58:35.383ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible/regions/45425fc2-77d9-4eec-a417-dbc2daf39351@66282e51-1b54-4615-a46d-430ecdd87e5a
432024-07-31T06:58:35.383ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b5858a03-073d-4bb1-b734-c31dcd7693e1/crucible/regions/45425fc2-77d9-4eec-a417-dbc2daf39351", "66282e51-1b54-4615-a46d-430ecdd87e5a"]
442024-07-31T06:58:35.392ZINFOcrucible-agent (datafile): requesting running snapshot 45425fc2-77d9-4eec-a417-dbc2daf39351-66282e51-1b54-4615-a46d-430ecdd87e5a state: Requested
452024-07-31T06:58:35.393ZINFOcrucible-agent (worker): applying SMF actions for region 45425fc2-77d9-4eec-a417-dbc2daf39351 running snapshot 66282e51-1b54-4615-a46d-430ecdd87e5a (state Requested)...
462024-07-31T06:58:35.393ZINFOcrucible-agent (dropshot): request completed latency_us = 27585 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48795 req_id = 9911b7db-18f9-4348-a954-7ecbb13a67ce response_code = 200 uri = /crucible/0/regions/45425fc2-77d9-4eec-a417-dbc2daf39351/snapshots/66282e51-1b54-4615-a46d-430ecdd87e5a/run
472024-07-31T06:58:35.399ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/45425fc2-77d9-4eec-a417-dbc2daf39351
482024-07-31T06:58:35.399ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
492024-07-31T06:58:35.399ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
502024-07-31T06:58:35.399ZINFOcrucible-agent (worker): reconfig required
512024-07-31T06:58:35.399ZINFOcrucible-agent (worker): using existing config property group
522024-07-31T06:58:35.399ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-45425fc2-77d9-4eec-a417-dbc2daf39351
532024-07-31T06:58:35.399ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/45425fc2-77d9-4eec-a417-dbc2daf39351
542024-07-31T06:58:35.399ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
552024-07-31T06:58:35.399ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
562024-07-31T06:58:35.399ZINFOcrucible-agent (worker): commit
572024-07-31T06:58:35.405ZINFOcrucible-agent (worker): ok!
582024-07-31T06:58:35.406ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-45425fc2-77d9-4eec-a417-dbc2daf39351-66282e51-1b54-4615-a46d-430ecdd87e5a
592024-07-31T06:58:35.413ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-45425fc2-77d9-4eec-a417-dbc2daf39351-66282e51-1b54-4615-a46d-430ecdd87e5a
602024-07-31T06:58:35.426ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-45425fc2-77d9-4eec-a417-dbc2daf39351-66282e51-1b54-4615-a46d-430ecdd87e5a
612024-07-31T06:58:35.426ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/45425fc2-77d9-4eec-a417-dbc2daf39351/.zfs/snapshot/66282e51-1b54-4615-a46d-430ecdd87e5a
622024-07-31T06:58:35.426ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
632024-07-31T06:58:35.426ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
642024-07-31T06:58:35.426ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
652024-07-31T06:58:35.426ZINFOcrucible-agent (worker): commit
662024-07-31T06:58:35.431ZINFOcrucible-agent (worker): ok!
672024-07-31T06:58:35.436ZINFOcrucible-agent (worker): SMF ok!
682024-07-31T06:58:35.436ZINFOcrucible-agent (datafile): region 45425fc2-77d9-4eec-a417-dbc2daf39351 running snapshot 66282e51-1b54-4615-a46d-430ecdd87e5a state: Requested -> Created