Max level shown:
1 [ Jul 4 19:24:38 Enabled. ]
2 [ Jul 4 19:24:38 Rereading configuration. ]
3 [ Jul 4 19:24:39 Rereading configuration. ]
4 [ Jul 4 19:24:42 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_9633ee26-fe12-4383-92d4-5ffe245edc8f/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-04T19:24:42.985ZINFOcrucible-agent: dataset: "oxp_9633ee26-fe12-4383-92d4-5ffe245edc8f/crucible"
72024-07-04T19:24:42.988ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-07-04T19:24:42.988ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-04T19:24:42.989ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-04T19:24:43.443ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112024-07-04T19:25:18.887ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:48341
122024-07-04T19:25:18.911ZINFOcrucible-agent (datafile): region f6791ebf-0846-4106-b932-cc90fffac40a state: Requested
132024-07-04T19:25:18.921ZINFOcrucible-agent (dropshot): request completed latency_us = 19606 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48341 req_id = 6aa734a6-242f-4c97-90a2-87252298977b response_code = 200 uri = /crucible/0/regions
142024-07-04T19:25:18.921ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-07-04T19:25:18.934ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_9633ee26-fe12-4383-92d4-5ffe245edc8f/crucible/regions/f6791ebf-0846-4106-b932-cc90fffac40a
162024-07-04T19:25:18.934ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_9633ee26-fe12-4383-92d4-5ffe245edc8f/crucible/regions/f6791ebf-0846-4106-b932-cc90fffac40a
172024-07-04T19:25:19.000ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f6791ebf-0846-4106-b932-cc90fffac40a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f6791ebf-0846-4106-b932-cc90fffac40a" region = f6791ebf-0846-4106-b932-cc90fffac40a
182024-07-04T19:25:19.003ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f6791ebf-0846-4106-b932-cc90fffac40a" "--data" "/data/regions/f6791ebf-0846-4106-b932-cc90fffac40a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = f6791ebf-0846-4106-b932-cc90fffac40a
192024-07-04T19:25:19.219ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48341 req_id = f1db91f0-c960-4f17-870e-0d4eb4ae57a9 response_code = 200 uri = /crucible/0/regions
202024-07-04T19:25:19.258ZINFOcrucible-agent (worker): region files created ok region = f6791ebf-0846-4106-b932-cc90fffac40a
212024-07-04T19:25:19.259ZINFOcrucible-agent (datafile): region f6791ebf-0846-4106-b932-cc90fffac40a state: Requested -> Created
222024-07-04T19:25:19.259ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-07-04T19:25:19.259ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f6791ebf-0846-4106-b932-cc90fffac40a
242024-07-04T19:25:19.264ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f6791ebf-0846-4106-b932-cc90fffac40a
252024-07-04T19:25:19.279ZINFOcrucible-agent (worker): creating config property group
262024-07-04T19:25:19.283ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f6791ebf-0846-4106-b932-cc90fffac40a
272024-07-04T19:25:19.283ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f6791ebf-0846-4106-b932-cc90fffac40a
282024-07-04T19:25:19.286ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-04T19:25:19.286ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
302024-07-04T19:25:19.286ZINFOcrucible-agent (worker): commit
312024-07-04T19:25:19.297ZINFOcrucible-agent (worker): ok!
322024-07-04T19:25:19.305ZINFOcrucible-agent (worker): SMF ok!
332024-07-04T19:25:19.637ZINFOcrucible-agent (dropshot): request completed latency_us = 528 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48341 req_id = 4b371067-b00a-4ffd-902e-263bc070f376 response_code = 200 uri = /crucible/0/regions
342024-07-04T19:25:19.839ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48341 req_id = ab271421-bdb9-42d1-a493-1223c13a7721 response_code = 200 uri = /crucible/0/regions/f6791ebf-0846-4106-b932-cc90fffac40a
352024-07-04T19:25:19.841ZINFOcrucible-agent (datafile): path is "/data/regions/f6791ebf-0846-4106-b932-cc90fffac40a"
362024-07-04T19:25:19.850ZINFOcrucible-agent (datafile): dataset is oxp_9633ee26-fe12-4383-92d4-5ffe245edc8f/crucible/regions/f6791ebf-0846-4106-b932-cc90fffac40a
372024-07-04T19:25:19.858ZINFOcrucible-agent (datafile): region f6791ebf-0846-4106-b932-cc90fffac40a state: Created -> Tombstoned
382024-07-04T19:25:19.859ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-07-04T19:25:19.859ZINFOcrucible-agent (dropshot): request completed latency_us = 18234 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:48341 req_id = cde9d85b-d8b0-4e41-bdc3-64bc51207093 response_code = 204 uri = /crucible/0/regions/f6791ebf-0846-4106-b932-cc90fffac40a
402024-07-04T19:25:19.860ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-f6791ebf-0846-4106-b932-cc90fffac40a (instance states: (Some(Online), None))
412024-07-04T19:25:19.862ZINFOcrucible-agent (dropshot): request completed latency_us = 601 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48341 req_id = eac73c6b-82e2-4c18-a4c2-ba71782821bd response_code = 200 uri = /crucible/0/regions/f6791ebf-0846-4106-b932-cc90fffac40a
422024-07-04T19:25:19.865ZINFOcrucible-agent (worker): SMF ok!
432024-07-04T19:25:19.874ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9633ee26-fe12-4383-92d4-5ffe245edc8f/crucible/regions/f6791ebf-0846-4106-b932-cc90fffac40a" region = f6791ebf-0846-4106-b932-cc90fffac40a
442024-07-04T19:25:19.931ZINFOcrucible-agent (datafile): region f6791ebf-0846-4106-b932-cc90fffac40a state: Tombstoned -> Destroyed
452024-07-04T19:25:20.002ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48341 req_id = fc9e9e23-a98c-4f8e-8a9d-a5cd7817d125 response_code = 200 uri = /crucible/0/regions/f6791ebf-0846-4106-b932-cc90fffac40a
462024-07-04T19:25:57.504ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:43896
472024-07-04T19:25:57.504ZINFOcrucible-agent (datafile): region 9c7860bc-23b6-4c4d-9d34-5cb2834aad1d state: Requested
482024-07-04T19:25:57.504ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-07-04T19:25:57.504ZINFOcrucible-agent (dropshot): request completed latency_us = 217 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43896 req_id = 3a225bde-7727-4c0a-ba62-dc1464595610 response_code = 200 uri = /crucible/0/regions
502024-07-04T19:25:57.513ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9633ee26-fe12-4383-92d4-5ffe245edc8f/crucible/regions/9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
512024-07-04T19:25:57.513ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9633ee26-fe12-4383-92d4-5ffe245edc8f/crucible/regions/9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
522024-07-04T19:25:57.563ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9c7860bc-23b6-4c4d-9d34-5cb2834aad1d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9c7860bc-23b6-4c4d-9d34-5cb2834aad1d" region = 9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
532024-07-04T19:25:57.564ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9c7860bc-23b6-4c4d-9d34-5cb2834aad1d" "--data" "/data/regions/9c7860bc-23b6-4c4d-9d34-5cb2834aad1d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
542024-07-04T19:25:57.626ZINFOcrucible-agent (worker): region files created ok region = 9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
552024-07-04T19:25:57.626ZINFOcrucible-agent (datafile): region 9c7860bc-23b6-4c4d-9d34-5cb2834aad1d state: Requested -> Created
562024-07-04T19:25:57.626ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-07-04T19:25:57.628ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
582024-07-04T19:25:57.630ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
592024-07-04T19:25:57.638ZINFOcrucible-agent (worker): creating config property group
602024-07-04T19:25:57.641ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
612024-07-04T19:25:57.641ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9c7860bc-23b6-4c4d-9d34-5cb2834aad1d
622024-07-04T19:25:57.641ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-07-04T19:25:57.641ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
642024-07-04T19:25:57.641ZINFOcrucible-agent (worker): commit
652024-07-04T19:25:57.645ZINFOcrucible-agent (worker): ok!
662024-07-04T19:25:57.649ZINFOcrucible-agent (worker): SMF ok!
672024-07-04T19:25:57.714ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43896 req_id = bbcb280d-1ea4-40a1-9d74-dfca1cb17c96 response_code = 200 uri = /crucible/0/regions