Max level shown:
1 [ Jul 10 23:58:15 Enabled. ]
2 [ Jul 10 23:58:15 Rereading configuration. ]
3 [ Jul 10 23:58:18 Rereading configuration. ]
4 [ Jul 10 23:58:20 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_d29abc28-1ae7-4192-8340-9766fa8fec22/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-10T23:58:20.788ZINFOcrucible-agent: dataset: "oxp_d29abc28-1ae7-4192-8340-9766fa8fec22/crucible"
72024-07-10T23:58:20.795ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82024-07-10T23:58:20.795ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-10T23:58:20.817ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-10T23:58:20.929ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
112024-07-10T23:59:20.198ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:44130
122024-07-10T23:59:20.218ZINFOcrucible-agent (datafile): region ec8fc9a7-932f-4d85-ae09-c2890953ceab state: Requested
132024-07-10T23:59:20.223ZINFOcrucible-agent (dropshot): request completed latency_us = 14157 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:44130 req_id = 834ca244-7c91-4a94-b9f8-3cc6ef01d648 response_code = 200 uri = /crucible/0/regions
142024-07-10T23:59:20.223ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-07-10T23:59:20.236ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_d29abc28-1ae7-4192-8340-9766fa8fec22/crucible/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab
162024-07-10T23:59:20.236ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_d29abc28-1ae7-4192-8340-9766fa8fec22/crucible/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab
172024-07-10T23:59:20.305ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ec8fc9a7-932f-4d85-ae09-c2890953ceab"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab" region = ec8fc9a7-932f-4d85-ae09-c2890953ceab
182024-07-10T23:59:20.307ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ec8fc9a7-932f-4d85-ae09-c2890953ceab" "--data" "/data/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = ec8fc9a7-932f-4d85-ae09-c2890953ceab
192024-07-10T23:59:20.402ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:44130 req_id = b79c5845-3dde-4483-8162-4d4c55b1aba9 response_code = 200 uri = /crucible/0/regions
202024-07-10T23:59:20.421ZINFOcrucible-agent (worker): region files created ok region = ec8fc9a7-932f-4d85-ae09-c2890953ceab
212024-07-10T23:59:20.421ZINFOcrucible-agent (datafile): region ec8fc9a7-932f-4d85-ae09-c2890953ceab state: Requested -> Created
222024-07-10T23:59:20.421ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-07-10T23:59:20.421ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ec8fc9a7-932f-4d85-ae09-c2890953ceab
242024-07-10T23:59:20.427ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ec8fc9a7-932f-4d85-ae09-c2890953ceab
252024-07-10T23:59:20.445ZINFOcrucible-agent (worker): creating config property group
262024-07-10T23:59:20.448ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ec8fc9a7-932f-4d85-ae09-c2890953ceab
272024-07-10T23:59:20.448ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab
282024-07-10T23:59:20.453ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-10T23:59:20.453ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
302024-07-10T23:59:20.453ZINFOcrucible-agent (worker): commit
312024-07-10T23:59:20.458ZINFOcrucible-agent (worker): ok!
322024-07-10T23:59:20.465ZINFOcrucible-agent (worker): SMF ok!
332024-07-10T23:59:20.932ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:44130 req_id = 679c8ec5-9685-4fad-96d3-e200e5700988 response_code = 200 uri = /crucible/0/regions
342024-07-10T23:59:21.508ZINFOcrucible-agent (dropshot): request completed latency_us = 603 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:44130 req_id = 2042cf2c-764b-4a3a-b3f9-3dbc6bf0cd07 response_code = 200 uri = /crucible/0/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab
352024-07-10T23:59:21.511ZINFOcrucible-agent (datafile): path is "/data/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab"
362024-07-10T23:59:21.520ZINFOcrucible-agent (datafile): dataset is oxp_d29abc28-1ae7-4192-8340-9766fa8fec22/crucible/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab
372024-07-10T23:59:21.529ZINFOcrucible-agent (datafile): region ec8fc9a7-932f-4d85-ae09-c2890953ceab state: Created -> Tombstoned
382024-07-10T23:59:21.529ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-07-10T23:59:21.529ZINFOcrucible-agent (dropshot): request completed latency_us = 18649 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:44130 req_id = 34858730-6e04-4718-93ac-922c47baf248 response_code = 204 uri = /crucible/0/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab
402024-07-10T23:59:21.530ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ec8fc9a7-932f-4d85-ae09-c2890953ceab (instance states: (Some(Online), None))
412024-07-10T23:59:21.532ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:44130 req_id = c011e03d-3936-47b3-a245-26a8cc60b836 response_code = 200 uri = /crucible/0/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab
422024-07-10T23:59:21.534ZINFOcrucible-agent (worker): SMF ok!
432024-07-10T23:59:21.543ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d29abc28-1ae7-4192-8340-9766fa8fec22/crucible/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab" region = ec8fc9a7-932f-4d85-ae09-c2890953ceab
442024-07-10T23:59:21.615ZINFOcrucible-agent (datafile): region ec8fc9a7-932f-4d85-ae09-c2890953ceab state: Tombstoned -> Destroyed
452024-07-10T23:59:21.668ZINFOcrucible-agent (dropshot): request completed latency_us = 622 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:44130 req_id = bada39d8-4167-41b8-86c6-e5461d7070ef response_code = 200 uri = /crucible/0/regions/ec8fc9a7-932f-4d85-ae09-c2890953ceab
462024-07-10T23:59:35.633ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:50621
472024-07-10T23:59:35.633ZINFOcrucible-agent (datafile): region 9efc25c6-5ce3-44d4-b13e-2162dff037e1 state: Requested
482024-07-10T23:59:35.635ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-07-10T23:59:35.635ZINFOcrucible-agent (dropshot): request completed latency_us = 2572 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50621 req_id = 82ffb3e3-6442-4bad-a079-861c003d7fcc response_code = 200 uri = /crucible/0/regions
502024-07-10T23:59:35.645ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d29abc28-1ae7-4192-8340-9766fa8fec22/crucible/regions/9efc25c6-5ce3-44d4-b13e-2162dff037e1
512024-07-10T23:59:35.645ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d29abc28-1ae7-4192-8340-9766fa8fec22/crucible/regions/9efc25c6-5ce3-44d4-b13e-2162dff037e1
522024-07-10T23:59:35.700ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9efc25c6-5ce3-44d4-b13e-2162dff037e1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9efc25c6-5ce3-44d4-b13e-2162dff037e1" region = 9efc25c6-5ce3-44d4-b13e-2162dff037e1
532024-07-10T23:59:35.702ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9efc25c6-5ce3-44d4-b13e-2162dff037e1" "--data" "/data/regions/9efc25c6-5ce3-44d4-b13e-2162dff037e1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9efc25c6-5ce3-44d4-b13e-2162dff037e1
542024-07-10T23:59:35.763ZINFOcrucible-agent (worker): region files created ok region = 9efc25c6-5ce3-44d4-b13e-2162dff037e1
552024-07-10T23:59:35.763ZINFOcrucible-agent (datafile): region 9efc25c6-5ce3-44d4-b13e-2162dff037e1 state: Requested -> Created
562024-07-10T23:59:35.763ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-07-10T23:59:35.764ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9efc25c6-5ce3-44d4-b13e-2162dff037e1
582024-07-10T23:59:35.768ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9efc25c6-5ce3-44d4-b13e-2162dff037e1
592024-07-10T23:59:35.775ZINFOcrucible-agent (worker): creating config property group
602024-07-10T23:59:35.778ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9efc25c6-5ce3-44d4-b13e-2162dff037e1
612024-07-10T23:59:35.778ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9efc25c6-5ce3-44d4-b13e-2162dff037e1
622024-07-10T23:59:35.778ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-07-10T23:59:35.778ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
642024-07-10T23:59:35.778ZINFOcrucible-agent (worker): commit
652024-07-10T23:59:35.783ZINFOcrucible-agent (worker): ok!
662024-07-10T23:59:35.787ZINFOcrucible-agent (worker): SMF ok!
672024-07-10T23:59:35.850ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50621 req_id = 607849e0-2170-4549-b9e8-43171bbd4c35 response_code = 200 uri = /crucible/0/regions