Max level shown:
1 [ May 30 04:27:46 Enabled. ]
2 [ May 30 04:27:46 Rereading configuration. ]
3 [ May 30 04:27:49 Rereading configuration. ]
4 [ May 30 04:27:52 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_9ce52aaf-e1e3-4cca-b885-4fb9c21dac08/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-05-30T04:27:52.412ZINFOcrucible-agent: dataset: "oxp_9ce52aaf-e1e3-4cca-b885-4fb9c21dac08/crucible"
72024-05-30T04:27:52.415ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-05-30T04:27:52.415ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-05-30T04:27:52.436ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-05-30T04:27:52.539ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-05-30T04:28:30.709ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:54754
122024-05-30T04:28:30.735ZINFOcrucible-agent (datafile): region 77cf4319-ae00-4dc0-9438-b15c30befba8 state: Requested
132024-05-30T04:28:30.742ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-05-30T04:28:30.746ZINFOcrucible-agent (dropshot): request completed latency_us = 18004 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54754 req_id = c786269b-eada-41c0-b199-055f94f30440 response_code = 200 uri = /crucible/0/regions
152024-05-30T04:28:30.751ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_9ce52aaf-e1e3-4cca-b885-4fb9c21dac08/crucible/regions/77cf4319-ae00-4dc0-9438-b15c30befba8
162024-05-30T04:28:30.751ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_9ce52aaf-e1e3-4cca-b885-4fb9c21dac08/crucible/regions/77cf4319-ae00-4dc0-9438-b15c30befba8
172024-05-30T04:28:30.810ZINFOcrucible-agent (worker): creating region Region { id: RegionId("77cf4319-ae00-4dc0-9438-b15c30befba8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/77cf4319-ae00-4dc0-9438-b15c30befba8" region = 77cf4319-ae00-4dc0-9438-b15c30befba8
182024-05-30T04:28:30.812ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "77cf4319-ae00-4dc0-9438-b15c30befba8" "--data" "/data/regions/77cf4319-ae00-4dc0-9438-b15c30befba8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 77cf4319-ae00-4dc0-9438-b15c30befba8
192024-05-30T04:28:30.929ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54754 req_id = 7a5b807c-5360-46fe-812e-dfc279d76ef9 response_code = 200 uri = /crucible/0/regions
202024-05-30T04:28:31.080ZINFOcrucible-agent (worker): region files created ok region = 77cf4319-ae00-4dc0-9438-b15c30befba8
212024-05-30T04:28:31.080ZINFOcrucible-agent (datafile): region 77cf4319-ae00-4dc0-9438-b15c30befba8 state: Requested -> Created
222024-05-30T04:28:31.080ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-05-30T04:28:31.081ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-77cf4319-ae00-4dc0-9438-b15c30befba8
242024-05-30T04:28:31.084ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-77cf4319-ae00-4dc0-9438-b15c30befba8
252024-05-30T04:28:31.093ZINFOcrucible-agent (worker): creating config property group
262024-05-30T04:28:31.096ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-77cf4319-ae00-4dc0-9438-b15c30befba8
272024-05-30T04:28:31.097ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/77cf4319-ae00-4dc0-9438-b15c30befba8
282024-05-30T04:28:31.097ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-05-30T04:28:31.097ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
302024-05-30T04:28:31.097ZINFOcrucible-agent (worker): commit
312024-05-30T04:28:31.101ZINFOcrucible-agent (worker): ok!
322024-05-30T04:28:31.105ZINFOcrucible-agent (worker): SMF ok!
332024-05-30T04:28:31.397ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54754 req_id = 5a0df366-7134-4c96-a38f-1e645007bc31 response_code = 200 uri = /crucible/0/regions
342024-05-30T04:28:32.015ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:57255
352024-05-30T04:28:32.015ZINFOcrucible-agent (dropshot): request completed latency_us = 95 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57255 req_id = a343ef88-ba85-4bf8-ab1c-dce85adaddc5 response_code = 200 uri = /crucible/0/regions/77cf4319-ae00-4dc0-9438-b15c30befba8
362024-05-30T04:28:32.015ZINFOcrucible-agent (datafile): path is "/data/regions/77cf4319-ae00-4dc0-9438-b15c30befba8"
372024-05-30T04:28:32.025ZINFOcrucible-agent (datafile): dataset is oxp_9ce52aaf-e1e3-4cca-b885-4fb9c21dac08/crucible/regions/77cf4319-ae00-4dc0-9438-b15c30befba8
382024-05-30T04:28:32.034ZINFOcrucible-agent (datafile): region 77cf4319-ae00-4dc0-9438-b15c30befba8 state: Created -> Tombstoned
392024-05-30T04:28:32.034ZINFOcrucible-agent (worker): applying SMF actions before removal...
402024-05-30T04:28:32.034ZINFOcrucible-agent (dropshot): request completed latency_us = 18790 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:57255 req_id = 799c586f-6289-4d9a-98f1-99fd40d21c6c response_code = 204 uri = /crucible/0/regions/77cf4319-ae00-4dc0-9438-b15c30befba8
412024-05-30T04:28:32.034ZINFOcrucible-agent (dropshot): request completed latency_us = 19 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57255 req_id = 6148b709-933f-4682-bebc-7f282479752a response_code = 200 uri = /crucible/0/regions/77cf4319-ae00-4dc0-9438-b15c30befba8
422024-05-30T04:28:32.035ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-77cf4319-ae00-4dc0-9438-b15c30befba8 (instance states: (Some(Online), None))
432024-05-30T04:28:32.039ZINFOcrucible-agent (worker): SMF ok!
442024-05-30T04:28:32.050ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9ce52aaf-e1e3-4cca-b885-4fb9c21dac08/crucible/regions/77cf4319-ae00-4dc0-9438-b15c30befba8" region = 77cf4319-ae00-4dc0-9438-b15c30befba8
452024-05-30T04:28:32.109ZINFOcrucible-agent (datafile): region 77cf4319-ae00-4dc0-9438-b15c30befba8 state: Tombstoned -> Destroyed
462024-05-30T04:28:32.110ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57255 req_id = 1686dcb8-0a6f-4506-821d-bce2a5d85370 response_code = 200 uri = /crucible/0/regions/77cf4319-ae00-4dc0-9438-b15c30befba8