Max level shown:
1 [ Mar 25 05:53:41 Enabled. ]
2 [ Mar 25 05:53:41 Rereading configuration. ]
3 [ Mar 25 05:53:46 Rereading configuration. ]
4 [ Mar 25 05:53:54 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_7abced3b-dc0d-4ffa-8875-0a3eb3b4d372/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-03-25T05:53:55.060ZINFOcrucible-agent: dataset: "oxp_7abced3b-dc0d-4ffa-8875-0a3eb3b4d372/crucible"
72025-03-25T05:53:55.063ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82025-03-25T05:53:55.063ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-03-25T05:53:55.079ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-03-25T05:53:55.222ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112025-03-25T05:54:28.781ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:44180
122025-03-25T05:54:28.826ZINFOcrucible-agent (datafile): region 09a759cf-2bb3-4430-84db-07c54a40797c state: Requested
132025-03-25T05:54:28.828ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142025-03-25T05:54:28.832ZINFOcrucible-agent (dropshot): request completed latency_us = 22050 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:44180 req_id = 5fa7fec0-3817-4389-94ed-fbe6758b5fca response_code = 200 uri = /crucible/0/regions
152025-03-25T05:54:28.839ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_7abced3b-dc0d-4ffa-8875-0a3eb3b4d372/crucible/regions/09a759cf-2bb3-4430-84db-07c54a40797c
162025-03-25T05:54:28.839ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_7abced3b-dc0d-4ffa-8875-0a3eb3b4d372/crucible/regions/09a759cf-2bb3-4430-84db-07c54a40797c
172025-03-25T05:54:28.898ZINFOcrucible-agent (worker): creating region Region { id: RegionId("09a759cf-2bb3-4430-84db-07c54a40797c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/09a759cf-2bb3-4430-84db-07c54a40797c" region = 09a759cf-2bb3-4430-84db-07c54a40797c
182025-03-25T05:54:28.900ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "09a759cf-2bb3-4430-84db-07c54a40797c" "--data" "/data/regions/09a759cf-2bb3-4430-84db-07c54a40797c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 09a759cf-2bb3-4430-84db-07c54a40797c
192025-03-25T05:54:29.024ZINFOcrucible-agent (worker): region files created ok region = 09a759cf-2bb3-4430-84db-07c54a40797c
202025-03-25T05:54:29.025ZINFOcrucible-agent (datafile): region 09a759cf-2bb3-4430-84db-07c54a40797c state: Requested -> Created
212025-03-25T05:54:29.025ZINFOcrucible-agent (worker): applying SMF actions post create...
222025-03-25T05:54:29.025ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-09a759cf-2bb3-4430-84db-07c54a40797c
232025-03-25T05:54:29.030ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-09a759cf-2bb3-4430-84db-07c54a40797c
242025-03-25T05:54:29.042ZINFOcrucible-agent (worker): creating config property group
252025-03-25T05:54:29.045ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-09a759cf-2bb3-4430-84db-07c54a40797c
262025-03-25T05:54:29.045ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/09a759cf-2bb3-4430-84db-07c54a40797c
272025-03-25T05:54:29.045ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282025-03-25T05:54:29.045ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
292025-03-25T05:54:29.046ZINFOcrucible-agent (worker): commit
302025-03-25T05:54:29.049ZINFOcrucible-agent (worker): ok!
312025-03-25T05:54:29.060ZINFOcrucible-agent (worker): SMF ok!
322025-03-25T05:54:29.112ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:44180 req_id = 3c0fa971-ca63-44dd-ac08-7638bb27a28d response_code = 200 uri = /crucible/0/regions
332025-03-25T05:54:29.793ZINFOcrucible-agent (dropshot): request completed latency_us = 2354 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:44180 req_id = 517c0440-1653-4102-8454-0bdc7ced9855 response_code = 200 uri = /crucible/0/regions/09a759cf-2bb3-4430-84db-07c54a40797c
342025-03-25T05:54:29.796ZINFOcrucible-agent (datafile): path is "/data/regions/09a759cf-2bb3-4430-84db-07c54a40797c"
352025-03-25T05:54:29.808ZINFOcrucible-agent (datafile): dataset is oxp_7abced3b-dc0d-4ffa-8875-0a3eb3b4d372/crucible/regions/09a759cf-2bb3-4430-84db-07c54a40797c
362025-03-25T05:54:29.818ZINFOcrucible-agent (datafile): region 09a759cf-2bb3-4430-84db-07c54a40797c state: Created -> Tombstoned
372025-03-25T05:54:29.818ZINFOcrucible-agent (worker): applying SMF actions before removal...
382025-03-25T05:54:29.818ZINFOcrucible-agent (dropshot): request completed latency_us = 22069 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:44180 req_id = 5969eebe-0ec9-439a-97b4-9cfcd029b12d response_code = 204 uri = /crucible/0/regions/09a759cf-2bb3-4430-84db-07c54a40797c
392025-03-25T05:54:29.819ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-09a759cf-2bb3-4430-84db-07c54a40797c (instance states: (Some(Online), None))
402025-03-25T05:54:29.821ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:44180 req_id = 0ed24cc2-d311-47b9-a73f-ad4ecf20f2db response_code = 200 uri = /crucible/0/regions/09a759cf-2bb3-4430-84db-07c54a40797c
412025-03-25T05:54:29.824ZINFOcrucible-agent (worker): SMF ok!
422025-03-25T05:54:29.836ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_7abced3b-dc0d-4ffa-8875-0a3eb3b4d372/crucible/regions/09a759cf-2bb3-4430-84db-07c54a40797c" region = 09a759cf-2bb3-4430-84db-07c54a40797c
432025-03-25T05:54:29.891ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:44180 req_id = 2c4d0400-a186-42ce-87ad-92f2d0b87a2b response_code = 200 uri = /crucible/0/regions/09a759cf-2bb3-4430-84db-07c54a40797c
442025-03-25T05:54:29.906ZINFOcrucible-agent (datafile): region 09a759cf-2bb3-4430-84db-07c54a40797c state: Tombstoned -> Destroyed
452025-03-25T05:54:30.003ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:44180 req_id = 38a0295c-6ec6-45b2-908f-46993a9e1f56 response_code = 200 uri = /crucible/0/regions/09a759cf-2bb3-4430-84db-07c54a40797c