Max level shown:
1 [ Feb 13 05:08:07 Enabled. ]
2 [ Feb 13 05:08:07 Rereading configuration. ]
3 [ Feb 13 05:08:10 Rereading configuration. ]
4 [ Feb 13 05:08:19 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_260eeacc-a97f-47c0-b604-100bb7d05b36/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-02-13T05:08:19.168ZINFOcrucible-agent: dataset: "oxp_260eeacc-a97f-47c0-b604-100bb7d05b36/crucible"
72025-02-13T05:08:19.171ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82025-02-13T05:08:19.171ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-02-13T05:08:19.185ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-02-13T05:08:19.237ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112025-02-13T05:08:34.502ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:33600
122025-02-13T05:08:34.510ZINFOcrucible-agent (datafile): region 5695f5ea-93ce-4987-9da3-01d01e5f6215 state: Requested
132025-02-13T05:08:34.511ZINFOcrucible-agent (dropshot): request completed latency_us = 3415 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33600 req_id = eee01bc9-6364-4516-bf46-8c4bedf6c9cd response_code = 200 uri = /crucible/0/regions
142025-02-13T05:08:34.513ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-02-13T05:08:34.523ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_260eeacc-a97f-47c0-b604-100bb7d05b36/crucible/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
162025-02-13T05:08:34.523ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_260eeacc-a97f-47c0-b604-100bb7d05b36/crucible/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
172025-02-13T05:08:34.582ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5695f5ea-93ce-4987-9da3-01d01e5f6215"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215" region = 5695f5ea-93ce-4987-9da3-01d01e5f6215
182025-02-13T05:08:34.584ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5695f5ea-93ce-4987-9da3-01d01e5f6215" "--data" "/data/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 5695f5ea-93ce-4987-9da3-01d01e5f6215
192025-02-13T05:08:34.706ZINFOcrucible-agent (worker): region files created ok region = 5695f5ea-93ce-4987-9da3-01d01e5f6215
202025-02-13T05:08:34.706ZINFOcrucible-agent (datafile): region 5695f5ea-93ce-4987-9da3-01d01e5f6215 state: Requested -> Created
212025-02-13T05:08:34.706ZINFOcrucible-agent (worker): applying SMF actions post create...
222025-02-13T05:08:34.707ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5695f5ea-93ce-4987-9da3-01d01e5f6215
232025-02-13T05:08:34.712ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5695f5ea-93ce-4987-9da3-01d01e5f6215
242025-02-13T05:08:34.722ZINFOcrucible-agent (worker): creating config property group
252025-02-13T05:08:34.726ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5695f5ea-93ce-4987-9da3-01d01e5f6215
262025-02-13T05:08:34.727ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
272025-02-13T05:08:34.729ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282025-02-13T05:08:34.730ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
292025-02-13T05:08:34.730ZINFOcrucible-agent (worker): commit
302025-02-13T05:08:34.731ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33600 req_id = 202aabac-4c7b-4fc5-8ef8-4a3a996494b3 response_code = 200 uri = /crucible/0/regions
312025-02-13T05:08:34.742ZINFOcrucible-agent (worker): ok!
322025-02-13T05:08:34.750ZINFOcrucible-agent (worker): SMF ok!
332025-02-13T05:08:35.170ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33600 req_id = 5756b85d-af88-4a8d-9466-c2ac00eeeda1 response_code = 200 uri = /crucible/0/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
342025-02-13T05:08:35.174ZINFOcrucible-agent (datafile): path is "/data/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215"
352025-02-13T05:08:35.185ZINFOcrucible-agent (datafile): dataset is oxp_260eeacc-a97f-47c0-b604-100bb7d05b36/crucible/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
362025-02-13T05:08:35.195ZINFOcrucible-agent (datafile): region 5695f5ea-93ce-4987-9da3-01d01e5f6215 state: Created -> Tombstoned
372025-02-13T05:08:35.195ZINFOcrucible-agent (worker): applying SMF actions before removal...
382025-02-13T05:08:35.195ZINFOcrucible-agent (dropshot): request completed latency_us = 20813 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:33600 req_id = b25553e7-b111-4bee-9308-1b35cef77c65 response_code = 204 uri = /crucible/0/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
392025-02-13T05:08:35.196ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5695f5ea-93ce-4987-9da3-01d01e5f6215 (instance states: (Some(Online), None))
402025-02-13T05:08:35.198ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33600 req_id = cccb137b-92ab-4f58-80bf-c1401397e170 response_code = 200 uri = /crucible/0/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
412025-02-13T05:08:35.203ZINFOcrucible-agent (worker): SMF ok!
422025-02-13T05:08:35.214ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_260eeacc-a97f-47c0-b604-100bb7d05b36/crucible/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215" region = 5695f5ea-93ce-4987-9da3-01d01e5f6215
432025-02-13T05:08:35.262ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33600 req_id = ecf407f9-5c33-429c-99f0-21acebdd9430 response_code = 200 uri = /crucible/0/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
442025-02-13T05:08:35.291ZINFOcrucible-agent (datafile): region 5695f5ea-93ce-4987-9da3-01d01e5f6215 state: Tombstoned -> Destroyed
452025-02-13T05:08:35.361ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33600 req_id = 4837e9fd-e062-4cb4-a209-ca903e89ec9a response_code = 200 uri = /crucible/0/regions/5695f5ea-93ce-4987-9da3-01d01e5f6215
462025-02-13T05:08:37.517ZINFOcrucible-agent (datafile): region c4897d96-0ec6-4c8d-802c-68b5c448a9cc state: Requested
472025-02-13T05:08:37.519ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482025-02-13T05:08:37.519ZINFOcrucible-agent (dropshot): request completed latency_us = 2275 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33600 req_id = ad114386-0373-4b19-a872-e57a00e1cb48 response_code = 200 uri = /crucible/0/regions
492025-02-13T05:08:37.528ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_260eeacc-a97f-47c0-b604-100bb7d05b36/crucible/regions/c4897d96-0ec6-4c8d-802c-68b5c448a9cc
502025-02-13T05:08:37.528ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_260eeacc-a97f-47c0-b604-100bb7d05b36/crucible/regions/c4897d96-0ec6-4c8d-802c-68b5c448a9cc
512025-02-13T05:08:37.607ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c4897d96-0ec6-4c8d-802c-68b5c448a9cc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c4897d96-0ec6-4c8d-802c-68b5c448a9cc" region = c4897d96-0ec6-4c8d-802c-68b5c448a9cc
522025-02-13T05:08:37.609ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c4897d96-0ec6-4c8d-802c-68b5c448a9cc" "--data" "/data/regions/c4897d96-0ec6-4c8d-802c-68b5c448a9cc" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c4897d96-0ec6-4c8d-802c-68b5c448a9cc
532025-02-13T05:08:37.684ZINFOcrucible-agent (worker): region files created ok region = c4897d96-0ec6-4c8d-802c-68b5c448a9cc
542025-02-13T05:08:37.684ZINFOcrucible-agent (datafile): region c4897d96-0ec6-4c8d-802c-68b5c448a9cc state: Requested -> Created
552025-02-13T05:08:37.684ZINFOcrucible-agent (worker): applying SMF actions post create...
562025-02-13T05:08:37.686ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c4897d96-0ec6-4c8d-802c-68b5c448a9cc
572025-02-13T05:08:37.689ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c4897d96-0ec6-4c8d-802c-68b5c448a9cc
582025-02-13T05:08:37.698ZINFOcrucible-agent (worker): creating config property group
592025-02-13T05:08:37.702ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c4897d96-0ec6-4c8d-802c-68b5c448a9cc
602025-02-13T05:08:37.702ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c4897d96-0ec6-4c8d-802c-68b5c448a9cc
612025-02-13T05:08:37.702ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622025-02-13T05:08:37.702ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
632025-02-13T05:08:37.702ZINFOcrucible-agent (worker): commit
642025-02-13T05:08:37.707ZINFOcrucible-agent (worker): ok!
652025-02-13T05:08:37.713ZINFOcrucible-agent (worker): SMF ok!
662025-02-13T05:08:37.765ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33600 req_id = 92aa20c1-9b5f-4e63-aea5-c770f0da73ac response_code = 200 uri = /crucible/0/regions