Max level shown:
1 [ Jan 8 01:15:33 Enabled. ]
2 [ Jan 8 01:15:33 Rereading configuration. ]
3 [ Jan 8 01:15:34 Rereading configuration. ]
4 [ Jan 8 01:15:38 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_18d62f42-16cd-4bde-97b1-47bd2b57dec9/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-01-08T01:15:39.184ZINFOcrucible-agent: dataset: "oxp_18d62f42-16cd-4bde-97b1-47bd2b57dec9/crucible"
72025-01-08T01:15:39.191ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82025-01-08T01:15:39.191ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-01-08T01:15:39.200ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-01-08T01:15:39.311ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112025-01-08T01:27:18.996ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:55658
122025-01-08T01:27:19.049ZINFOcrucible-agent (datafile): region 7768785d-1f1d-4ee3-8364-a0320cc3a21b state: Requested
132025-01-08T01:27:19.054ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142025-01-08T01:27:19.060ZINFOcrucible-agent (dropshot): request completed latency_us = 18071 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55658 req_id = 2d36f27e-5289-4bf6-a58a-bd9eef3a3ee5 response_code = 200 uri = /crucible/0/regions
152025-01-08T01:27:19.070ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_18d62f42-16cd-4bde-97b1-47bd2b57dec9/crucible/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b
162025-01-08T01:27:19.070ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_18d62f42-16cd-4bde-97b1-47bd2b57dec9/crucible/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b
172025-01-08T01:27:19.128ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7768785d-1f1d-4ee3-8364-a0320cc3a21b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b" region = 7768785d-1f1d-4ee3-8364-a0320cc3a21b
182025-01-08T01:27:19.131ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7768785d-1f1d-4ee3-8364-a0320cc3a21b" "--data" "/data/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7768785d-1f1d-4ee3-8364-a0320cc3a21b
192025-01-08T01:27:19.263ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55658 req_id = a253b509-7336-4b79-ab61-cc50db787ca2 response_code = 200 uri = /crucible/0/regions
202025-01-08T01:27:19.436ZINFOcrucible-agent (worker): region files created ok region = 7768785d-1f1d-4ee3-8364-a0320cc3a21b
212025-01-08T01:27:19.436ZINFOcrucible-agent (datafile): region 7768785d-1f1d-4ee3-8364-a0320cc3a21b state: Requested -> Created
222025-01-08T01:27:19.436ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-01-08T01:27:19.437ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7768785d-1f1d-4ee3-8364-a0320cc3a21b
242025-01-08T01:27:19.445ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7768785d-1f1d-4ee3-8364-a0320cc3a21b
252025-01-08T01:27:19.462ZINFOcrucible-agent (worker): creating config property group
262025-01-08T01:27:19.465ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7768785d-1f1d-4ee3-8364-a0320cc3a21b
272025-01-08T01:27:19.466ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b
282025-01-08T01:27:19.466ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-01-08T01:27:19.466ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302025-01-08T01:27:19.466ZINFOcrucible-agent (worker): commit
312025-01-08T01:27:19.470ZINFOcrucible-agent (worker): ok!
322025-01-08T01:27:19.475ZINFOcrucible-agent (worker): SMF ok!
332025-01-08T01:27:19.914ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55658 req_id = 55d35d09-fb9e-4021-b5bf-e21be5d859af response_code = 200 uri = /crucible/0/regions
342025-01-08T01:27:45.174ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55658 req_id = e1975e94-72b1-4ce5-a0a6-f1f2b36e7aa5 response_code = 200 uri = /crucible/0/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b
352025-01-08T01:27:45.177ZINFOcrucible-agent (datafile): path is "/data/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b"
362025-01-08T01:27:45.188ZINFOcrucible-agent (datafile): dataset is oxp_18d62f42-16cd-4bde-97b1-47bd2b57dec9/crucible/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b
372025-01-08T01:27:45.197ZINFOcrucible-agent (datafile): region 7768785d-1f1d-4ee3-8364-a0320cc3a21b state: Created -> Tombstoned
382025-01-08T01:27:45.198ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-01-08T01:27:45.198ZINFOcrucible-agent (dropshot): request completed latency_us = 21001 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:55658 req_id = 8d061bda-2ed0-4531-9afc-3e8549b54e12 response_code = 204 uri = /crucible/0/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b
402025-01-08T01:27:45.200ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55658 req_id = e436a8df-39f8-43f9-b5b3-7071d110ad2c response_code = 200 uri = /crucible/0/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b
412025-01-08T01:27:45.201ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-7768785d-1f1d-4ee3-8364-a0320cc3a21b (instance states: (Some(Online), None))
422025-01-08T01:27:45.206ZINFOcrucible-agent (worker): SMF ok!
432025-01-08T01:27:45.219ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_18d62f42-16cd-4bde-97b1-47bd2b57dec9/crucible/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b" region = 7768785d-1f1d-4ee3-8364-a0320cc3a21b
442025-01-08T01:27:45.282ZINFOcrucible-agent (datafile): region 7768785d-1f1d-4ee3-8364-a0320cc3a21b state: Tombstoned -> Destroyed
452025-01-08T01:27:45.348ZINFOcrucible-agent (dropshot): request completed latency_us = 608 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55658 req_id = 2652e5fd-121d-4da0-aba5-3c619cd6cd56 response_code = 200 uri = /crucible/0/regions/7768785d-1f1d-4ee3-8364-a0320cc3a21b