Max level shown:
1 [ Feb 24 04:56:58 Enabled. ]
2 [ Feb 24 04:56:58 Rereading configuration. ]
3 [ Feb 24 04:57:04 Rereading configuration. ]
4 [ Feb 24 04:57:10 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-02-24T04:57:10.928ZINFOcrucible-agent: dataset: "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"
72024-02-24T04:57:10.933ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-02-24T04:57:10.933ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-02-24T04:57:11.067ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
102024-02-24T04:57:50.240ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:59640
112024-02-24T04:57:50.276ZINFOcrucible-agent (datafile): region 20c21195-698d-445a-a7a6-cc130fec1f78 state: Requested
122024-02-24T04:57:50.277ZINFOcrucible-agent (dropshot): request completed latency_us = 1020 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59640 req_id = 9c83c717-aa6b-488f-9103-3ffa3b4f5137 response_code = 200 uri = /crucible/0/regions
132024-02-24T04:57:50.277ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-02-24T04:57:50.285ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/20c21195-698d-445a-a7a6-cc130fec1f78
152024-02-24T04:57:50.285ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/20c21195-698d-445a-a7a6-cc130fec1f78
162024-02-24T04:57:50.355ZINFOcrucible-agent (worker): creating region Region { id: RegionId("20c21195-698d-445a-a7a6-cc130fec1f78"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/20c21195-698d-445a-a7a6-cc130fec1f78" region = 20c21195-698d-445a-a7a6-cc130fec1f78
172024-02-24T04:57:50.472ZINFOcrucible-agent (worker): region files created ok region = 20c21195-698d-445a-a7a6-cc130fec1f78
182024-02-24T04:57:50.472ZINFOcrucible-agent (datafile): region 20c21195-698d-445a-a7a6-cc130fec1f78 state: Requested -> Created
192024-02-24T04:57:50.473ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-02-24T04:57:50.473ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-20c21195-698d-445a-a7a6-cc130fec1f78
212024-02-24T04:57:50.476ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-20c21195-698d-445a-a7a6-cc130fec1f78
222024-02-24T04:57:50.484ZINFOcrucible-agent (worker): creating config property group
232024-02-24T04:57:50.488ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-20c21195-698d-445a-a7a6-cc130fec1f78
242024-02-24T04:57:50.488ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/20c21195-698d-445a-a7a6-cc130fec1f78
252024-02-24T04:57:50.489ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-02-24T04:57:50.489ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
272024-02-24T04:57:50.489ZINFOcrucible-agent (worker): commit
282024-02-24T04:57:50.492ZINFOcrucible-agent (worker): ok!
292024-02-24T04:57:50.497ZINFOcrucible-agent (worker): SMF ok!
302024-02-24T04:57:50.518ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59640 req_id = edc00b52-3d84-45fe-95c8-e474f725cc68 response_code = 200 uri = /crucible/0/regions
312024-02-24T04:57:51.069ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:46191
322024-02-24T04:57:51.069ZINFOcrucible-agent (dropshot): request completed latency_us = 101 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46191 req_id = b2f0cb18-4879-481a-9e3c-5d066154b174 response_code = 200 uri = /crucible/0/regions/20c21195-698d-445a-a7a6-cc130fec1f78
332024-02-24T04:57:51.069ZINFOcrucible-agent (datafile): path is "/data/regions/20c21195-698d-445a-a7a6-cc130fec1f78"
342024-02-24T04:57:51.078ZINFOcrucible-agent (datafile): dataset is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/20c21195-698d-445a-a7a6-cc130fec1f78
352024-02-24T04:57:51.087ZINFOcrucible-agent (datafile): region 20c21195-698d-445a-a7a6-cc130fec1f78 state: Created -> Tombstoned
362024-02-24T04:57:51.087ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-02-24T04:57:51.088ZINFOcrucible-agent (dropshot): request completed latency_us = 18153 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:46191 req_id = 434e6a12-2850-4ee7-a255-4b1721ce7252 response_code = 204 uri = /crucible/0/regions/20c21195-698d-445a-a7a6-cc130fec1f78
382024-02-24T04:57:51.088ZINFOcrucible-agent (dropshot): request completed latency_us = 20 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46191 req_id = e7396d95-6585-4267-8e3a-ffd38d08758e response_code = 200 uri = /crucible/0/regions/20c21195-698d-445a-a7a6-cc130fec1f78
392024-02-24T04:57:51.088ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-20c21195-698d-445a-a7a6-cc130fec1f78 (instance states: (Some(Online), None))
402024-02-24T04:57:51.093ZINFOcrucible-agent (worker): SMF ok!
412024-02-24T04:57:51.103ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/20c21195-698d-445a-a7a6-cc130fec1f78" region = 20c21195-698d-445a-a7a6-cc130fec1f78
422024-02-24T04:57:51.163ZINFOcrucible-agent (datafile): region 20c21195-698d-445a-a7a6-cc130fec1f78 state: Tombstoned -> Destroyed
432024-02-24T04:57:51.190ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46191 req_id = b959f628-e8d5-4cf7-85c6-86f897f907f5 response_code = 200 uri = /crucible/0/regions/20c21195-698d-445a-a7a6-cc130fec1f78
442024-02-24T04:58:31.242ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:54597
452024-02-24T04:58:31.272ZINFOcrucible-agent (datafile): region 53cd9f2b-40f7-4b58-bad8-9b085ef580cd state: Requested
462024-02-24T04:58:31.273ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
472024-02-24T04:58:31.273ZINFOcrucible-agent (dropshot): request completed latency_us = 351 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54597 req_id = 34871948-efcc-495e-96a7-a145b41fc819 response_code = 200 uri = /crucible/0/regions
482024-02-24T04:58:31.281ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/53cd9f2b-40f7-4b58-bad8-9b085ef580cd
492024-02-24T04:58:31.281ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/53cd9f2b-40f7-4b58-bad8-9b085ef580cd
502024-02-24T04:58:31.325ZINFOcrucible-agent (worker): creating region Region { id: RegionId("53cd9f2b-40f7-4b58-bad8-9b085ef580cd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/53cd9f2b-40f7-4b58-bad8-9b085ef580cd" region = 53cd9f2b-40f7-4b58-bad8-9b085ef580cd
512024-02-24T04:58:31.386ZINFOcrucible-agent (worker): region files created ok region = 53cd9f2b-40f7-4b58-bad8-9b085ef580cd
522024-02-24T04:58:31.386ZINFOcrucible-agent (datafile): region 53cd9f2b-40f7-4b58-bad8-9b085ef580cd state: Requested -> Created
532024-02-24T04:58:31.386ZINFOcrucible-agent (worker): applying SMF actions post create...
542024-02-24T04:58:31.388ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-53cd9f2b-40f7-4b58-bad8-9b085ef580cd
552024-02-24T04:58:31.391ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-53cd9f2b-40f7-4b58-bad8-9b085ef580cd
562024-02-24T04:58:31.397ZINFOcrucible-agent (worker): creating config property group
572024-02-24T04:58:31.399ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-53cd9f2b-40f7-4b58-bad8-9b085ef580cd
582024-02-24T04:58:31.400ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/53cd9f2b-40f7-4b58-bad8-9b085ef580cd
592024-02-24T04:58:31.400ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
602024-02-24T04:58:31.400ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
612024-02-24T04:58:31.400ZINFOcrucible-agent (worker): commit
622024-02-24T04:58:31.403ZINFOcrucible-agent (worker): ok!
632024-02-24T04:58:31.408ZINFOcrucible-agent (worker): SMF ok!
642024-02-24T04:58:31.496ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54597 req_id = 97e1823d-8103-4730-9c4a-2e5b69fe3f03 response_code = 200 uri = /crucible/0/regions