Max level shown:
1 [ Apr 16 04:27:16 Enabled. ]
2 [ Apr 16 04:27:16 Rereading configuration. ]
3 [ Apr 16 04:27:17 Rereading configuration. ]
4 [ Apr 16 04:27:21 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_090497da-bd32-4a8a-b33c-6c9227a83504/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-04-16T04:27:21.655ZINFOcrucible-agent: dataset: "oxp_090497da-bd32-4a8a-b33c-6c9227a83504/crucible"
72025-04-16T04:27:21.658ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82025-04-16T04:27:21.658ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-04-16T04:27:21.681ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-04-16T04:27:21.764ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112025-04-16T04:27:36.558ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:61962
122025-04-16T04:27:36.580ZINFOcrucible-agent (datafile): region 3079e917-1db2-487c-b150-671ec7d9049f state: Requested
132025-04-16T04:27:36.581ZINFOcrucible-agent (dropshot): request completed latency_us = 5788 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61962 req_id = 720ea119-b86c-42ab-bde0-e091f1718567 response_code = 200 uri = /crucible/0/regions
142025-04-16T04:27:36.583ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-04-16T04:27:36.591ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_090497da-bd32-4a8a-b33c-6c9227a83504/crucible/regions/3079e917-1db2-487c-b150-671ec7d9049f
162025-04-16T04:27:36.591ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_090497da-bd32-4a8a-b33c-6c9227a83504/crucible/regions/3079e917-1db2-487c-b150-671ec7d9049f
172025-04-16T04:27:36.655ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3079e917-1db2-487c-b150-671ec7d9049f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3079e917-1db2-487c-b150-671ec7d9049f" region = 3079e917-1db2-487c-b150-671ec7d9049f
182025-04-16T04:27:36.658ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3079e917-1db2-487c-b150-671ec7d9049f" "--data" "/data/regions/3079e917-1db2-487c-b150-671ec7d9049f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 3079e917-1db2-487c-b150-671ec7d9049f
192025-04-16T04:27:36.789ZINFOcrucible-agent (worker): region files created ok region = 3079e917-1db2-487c-b150-671ec7d9049f
202025-04-16T04:27:36.789ZINFOcrucible-agent (datafile): region 3079e917-1db2-487c-b150-671ec7d9049f state: Requested -> Created
212025-04-16T04:27:36.789ZINFOcrucible-agent (worker): applying SMF actions post create...
222025-04-16T04:27:36.789ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3079e917-1db2-487c-b150-671ec7d9049f
232025-04-16T04:27:36.798ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3079e917-1db2-487c-b150-671ec7d9049f
242025-04-16T04:27:36.810ZINFOcrucible-agent (worker): creating config property group
252025-04-16T04:27:36.814ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3079e917-1db2-487c-b150-671ec7d9049f
262025-04-16T04:27:36.815ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3079e917-1db2-487c-b150-671ec7d9049f
272025-04-16T04:27:36.815ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282025-04-16T04:27:36.815ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
292025-04-16T04:27:36.815ZINFOcrucible-agent (worker): commit
302025-04-16T04:27:36.819ZINFOcrucible-agent (worker): ok!
312025-04-16T04:27:36.823ZINFOcrucible-agent (worker): SMF ok!
322025-04-16T04:27:36.904ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61962 req_id = bdf1bacb-16f7-4c0d-803a-c41f9a0b2ab7 response_code = 200 uri = /crucible/0/regions
332025-04-16T04:27:37.676ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61962 req_id = 60aa1b2f-e984-44ac-a0ec-35ec5dc655e0 response_code = 200 uri = /crucible/0/regions/3079e917-1db2-487c-b150-671ec7d9049f
342025-04-16T04:27:37.679ZINFOcrucible-agent (datafile): path is "/data/regions/3079e917-1db2-487c-b150-671ec7d9049f"
352025-04-16T04:27:37.691ZINFOcrucible-agent (datafile): dataset is oxp_090497da-bd32-4a8a-b33c-6c9227a83504/crucible/regions/3079e917-1db2-487c-b150-671ec7d9049f
362025-04-16T04:27:37.701ZINFOcrucible-agent (datafile): region 3079e917-1db2-487c-b150-671ec7d9049f state: Created -> Tombstoned
372025-04-16T04:27:37.701ZINFOcrucible-agent (worker): applying SMF actions before removal...
382025-04-16T04:27:37.701ZINFOcrucible-agent (dropshot): request completed latency_us = 21857 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:61962 req_id = b9f411dc-84dd-437e-aa37-a3c02885550c response_code = 204 uri = /crucible/0/regions/3079e917-1db2-487c-b150-671ec7d9049f
392025-04-16T04:27:37.702ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3079e917-1db2-487c-b150-671ec7d9049f (instance states: (Some(Online), None))
402025-04-16T04:27:37.705ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61962 req_id = c7f45925-0df6-4cad-875d-e8934be98cd7 response_code = 200 uri = /crucible/0/regions/3079e917-1db2-487c-b150-671ec7d9049f
412025-04-16T04:27:37.715ZINFOcrucible-agent (worker): SMF ok!
422025-04-16T04:27:37.728ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_090497da-bd32-4a8a-b33c-6c9227a83504/crucible/regions/3079e917-1db2-487c-b150-671ec7d9049f" region = 3079e917-1db2-487c-b150-671ec7d9049f
432025-04-16T04:27:37.806ZINFOcrucible-agent (datafile): region 3079e917-1db2-487c-b150-671ec7d9049f state: Tombstoned -> Destroyed
442025-04-16T04:27:37.841ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61962 req_id = 87ff0656-c33e-4041-ae65-59d1c468fa07 response_code = 200 uri = /crucible/0/regions/3079e917-1db2-487c-b150-671ec7d9049f