Max level shown:
1 [ May 14 16:32:46 Enabled. ]
2 [ May 14 16:32:47 Rereading configuration. ]
3 [ May 14 16:32:49 Rereading configuration. ]
4 [ May 14 16:32:54 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_629aaf3f-7086-47ac-860d-3c2d1e050a7f/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-05-14T16:32:54.690ZINFOcrucible-agent: dataset: "oxp_629aaf3f-7086-47ac-860d-3c2d1e050a7f/crucible"
72025-05-14T16:32:54.697ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82025-05-14T16:32:54.697ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-05-14T16:32:54.719ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-05-14T16:32:54.831ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112025-05-14T16:44:38.540ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:65117
122025-05-14T16:44:38.587ZINFOcrucible-agent (datafile): region c1d76fd8-50c5-4770-8c11-c4c2189bb8c1 state: Requested
132025-05-14T16:44:38.590ZINFOcrucible-agent (dropshot): request completed latency_us = 23471 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65117 req_id = d1cc3ce8-7cba-49af-8363-7c36aeb73d9c response_code = 200 uri = /crucible/0/regions
142025-05-14T16:44:38.593ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152025-05-14T16:44:38.605ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_629aaf3f-7086-47ac-860d-3c2d1e050a7f/crucible/regions/c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
162025-05-14T16:44:38.605ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_629aaf3f-7086-47ac-860d-3c2d1e050a7f/crucible/regions/c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
172025-05-14T16:44:38.657ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c1d76fd8-50c5-4770-8c11-c4c2189bb8c1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c1d76fd8-50c5-4770-8c11-c4c2189bb8c1" region = c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
182025-05-14T16:44:38.659ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c1d76fd8-50c5-4770-8c11-c4c2189bb8c1" "--data" "/data/regions/c1d76fd8-50c5-4770-8c11-c4c2189bb8c1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
192025-05-14T16:44:38.776ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65117 req_id = e7bbfb7f-e17a-4d82-b5d4-42bf11cec7f9 response_code = 200 uri = /crucible/0/regions
202025-05-14T16:44:38.976ZINFOcrucible-agent (worker): region files created ok region = c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
212025-05-14T16:44:38.976ZINFOcrucible-agent (datafile): region c1d76fd8-50c5-4770-8c11-c4c2189bb8c1 state: Requested -> Created
222025-05-14T16:44:38.976ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-05-14T16:44:38.976ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
242025-05-14T16:44:38.989ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
252025-05-14T16:44:39.014ZINFOcrucible-agent (worker): creating config property group
262025-05-14T16:44:39.017ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
272025-05-14T16:44:39.017ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
282025-05-14T16:44:39.022ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-05-14T16:44:39.022ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
302025-05-14T16:44:39.022ZINFOcrucible-agent (worker): commit
312025-05-14T16:44:39.036ZINFOcrucible-agent (worker): ok!
322025-05-14T16:44:39.042ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65117 req_id = 48d07f6e-1c7c-47c4-ae27-e3f6cc6a76bc response_code = 200 uri = /crucible/0/regions
332025-05-14T16:44:39.042ZINFOcrucible-agent (worker): SMF ok!
342025-05-14T16:44:46.370ZINFOcrucible-agent (datafile): region ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79 state: Requested
352025-05-14T16:44:46.370ZINFOcrucible-agent (dropshot): request completed latency_us = 207 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65117 req_id = 7a898f4a-f1de-4877-8de0-ff7ecfb3ef9e response_code = 200 uri = /crucible/0/regions
362025-05-14T16:44:46.370ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372025-05-14T16:44:46.380ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_629aaf3f-7086-47ac-860d-3c2d1e050a7f/crucible/regions/ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
382025-05-14T16:44:46.380ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_629aaf3f-7086-47ac-860d-3c2d1e050a7f/crucible/regions/ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
392025-05-14T16:44:46.489ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79" region = ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
402025-05-14T16:44:46.489ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79" "--data" "/data/regions/ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
412025-05-14T16:44:46.689ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65117 req_id = 5da6c35d-ef99-4185-a6d4-254c0cb035af response_code = 200 uri = /crucible/0/regions
422025-05-14T16:44:46.708ZINFOcrucible-agent (worker): region files created ok region = ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
432025-05-14T16:44:46.708ZINFOcrucible-agent (datafile): region ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79 state: Requested -> Created
442025-05-14T16:44:46.708ZINFOcrucible-agent (worker): applying SMF actions post create...
452025-05-14T16:44:46.709ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
462025-05-14T16:44:46.710ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
472025-05-14T16:44:46.710ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
482025-05-14T16:44:46.710ZINFOcrucible-agent (worker): reconfig required
492025-05-14T16:44:46.710ZINFOcrucible-agent (worker): using existing config property group
502025-05-14T16:44:46.710ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
512025-05-14T16:44:46.710ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c1d76fd8-50c5-4770-8c11-c4c2189bb8c1
522025-05-14T16:44:46.710ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532025-05-14T16:44:46.710ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
542025-05-14T16:44:46.710ZINFOcrucible-agent (worker): commit
552025-05-14T16:44:46.722ZINFOcrucible-agent (worker): ok!
562025-05-14T16:44:46.723ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
572025-05-14T16:44:46.738ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
582025-05-14T16:44:46.774ZINFOcrucible-agent (worker): creating config property group
592025-05-14T16:44:46.790ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
602025-05-14T16:44:46.790ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ebdf4cc8-67f0-4d21-82f0-28e3fc5e0f79
612025-05-14T16:44:46.791ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
622025-05-14T16:44:46.791ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
632025-05-14T16:44:46.791ZINFOcrucible-agent (worker): commit
642025-05-14T16:44:46.804ZINFOcrucible-agent (worker): ok!
652025-05-14T16:44:46.822ZINFOcrucible-agent (worker): SMF ok!
662025-05-14T16:44:47.346ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65117 req_id = bbd45e22-f4fb-4272-8f26-a11e638e350f response_code = 200 uri = /crucible/0/regions