Max level shown:
1 [ Feb 11 20:45:01 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_f977a1c6-a3f2-455b-9965-10f9d2675714/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
2 note: configured to log to "/dev/stdout"
32025-02-11T20:45:01.753ZINFOcrucible-agent: dataset: "oxp_f977a1c6-a3f2-455b-9965-10f9d2675714/crucible"
42025-02-11T20:45:01.757ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
52025-02-11T20:45:01.757ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
62025-02-11T20:45:01.786ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
72025-02-11T20:45:01.944ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
82025-02-11T20:55:59.651ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:48098
92025-02-11T20:55:59.689ZINFOcrucible-agent (datafile): region ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8 state: Requested
102025-02-11T20:55:59.695ZINFOcrucible-agent (dropshot): request completed latency_us = 19234 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48098 req_id = c8a56b96-e7c1-439b-a233-fc5fdaa9d82b response_code = 200 uri = /crucible/0/regions
112025-02-11T20:55:59.695ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
122025-02-11T20:55:59.708ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f977a1c6-a3f2-455b-9965-10f9d2675714/crucible/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
132025-02-11T20:55:59.708ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f977a1c6-a3f2-455b-9965-10f9d2675714/crucible/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
142025-02-11T20:55:59.761ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8" region = ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
152025-02-11T20:55:59.763ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8" "--data" "/data/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
162025-02-11T20:56:00.015ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48098 req_id = 5b0206f9-ba19-40b1-9a2e-61b7c409ee3f response_code = 200 uri = /crucible/0/regions
172025-02-11T20:56:00.086ZINFOcrucible-agent (worker): region files created ok region = ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
182025-02-11T20:56:00.086ZINFOcrucible-agent (datafile): region ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8 state: Requested -> Created
192025-02-11T20:56:00.087ZINFOcrucible-agent (worker): applying SMF actions post create...
202025-02-11T20:56:00.087ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
212025-02-11T20:56:00.092ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
222025-02-11T20:56:00.106ZINFOcrucible-agent (worker): creating config property group
232025-02-11T20:56:00.110ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
242025-02-11T20:56:00.110ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
252025-02-11T20:56:00.112ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262025-02-11T20:56:00.113ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
272025-02-11T20:56:00.113ZINFOcrucible-agent (worker): commit
282025-02-11T20:56:00.126ZINFOcrucible-agent (worker): ok!
292025-02-11T20:56:00.130ZINFOcrucible-agent (worker): SMF ok!
302025-02-11T20:56:00.395ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48098 req_id = 0cf06f1f-695a-40e2-a48f-7a5e64d83289 response_code = 200 uri = /crucible/0/regions
312025-02-11T20:56:26.324ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48098 req_id = c0a7eb2b-6425-416b-9f63-08f0bff95c9f response_code = 200 uri = /crucible/0/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
322025-02-11T20:56:26.327ZINFOcrucible-agent (datafile): path is "/data/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8"
332025-02-11T20:56:26.345ZINFOcrucible-agent (datafile): dataset is oxp_f977a1c6-a3f2-455b-9965-10f9d2675714/crucible/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
342025-02-11T20:56:26.355ZINFOcrucible-agent (datafile): region ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8 state: Created -> Tombstoned
352025-02-11T20:56:26.355ZINFOcrucible-agent (worker): applying SMF actions before removal...
362025-02-11T20:56:26.356ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8 (instance states: (Some(Online), None))
372025-02-11T20:56:26.358ZINFOcrucible-agent (dropshot): request completed latency_us = 30594 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:48098 req_id = d036d5ce-e0b9-4e38-b743-b4fdc84553c6 response_code = 204 uri = /crucible/0/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
382025-02-11T20:56:26.361ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48098 req_id = 3ee07f60-52e4-4bc9-9d8e-9c1c70195dbc response_code = 200 uri = /crucible/0/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
392025-02-11T20:56:26.386ZINFOcrucible-agent (worker): SMF ok!
402025-02-11T20:56:26.399ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f977a1c6-a3f2-455b-9965-10f9d2675714/crucible/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8" region = ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
412025-02-11T20:56:26.490ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48098 req_id = d0bf701c-fc1d-4510-9758-a0edf32faa81 response_code = 200 uri = /crucible/0/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8
422025-02-11T20:56:26.533ZINFOcrucible-agent (datafile): region ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8 state: Tombstoned -> Destroyed
432025-02-11T20:56:26.656ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48098 req_id = 9e87b3d6-1585-4354-80ad-03fa3e6df7b2 response_code = 200 uri = /crucible/0/regions/ac1eeeb0-a8f7-4312-9f94-1dba0f0555c8