Max level shown:
1 [ Jan 9 01:03:31 Enabled. ]
2 [ Jan 9 01:03:31 Rereading configuration. ]
3 [ Jan 9 01:03:34 Rereading configuration. ]
4 [ Jan 9 01:03:38 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_a132b3b6-342d-41c2-a6be-600f78f98f46/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-01-09T01:03:39.071ZINFOcrucible-agent: dataset: "oxp_a132b3b6-342d-41c2-a6be-600f78f98f46/crucible"
72025-01-09T01:03:39.076ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82025-01-09T01:03:39.076ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-01-09T01:03:39.091ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-01-09T01:03:39.167ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112025-01-09T01:14:12.978ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:40855
122025-01-09T01:14:13.026ZINFOcrucible-agent (datafile): region b6a4d26c-f6af-4112-b32d-7ab5c1dda91d state: Requested
132025-01-09T01:14:13.032ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142025-01-09T01:14:13.037ZINFOcrucible-agent (dropshot): request completed latency_us = 17804 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40855 req_id = 8c2279ec-0daa-4e8b-9350-77f9c72124ae response_code = 200 uri = /crucible/0/regions
152025-01-09T01:14:13.048ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a132b3b6-342d-41c2-a6be-600f78f98f46/crucible/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
162025-01-09T01:14:13.048ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a132b3b6-342d-41c2-a6be-600f78f98f46/crucible/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
172025-01-09T01:14:13.096ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b6a4d26c-f6af-4112-b32d-7ab5c1dda91d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d" region = b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
182025-01-09T01:14:13.098ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b6a4d26c-f6af-4112-b32d-7ab5c1dda91d" "--data" "/data/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
192025-01-09T01:14:13.282ZINFOcrucible-agent (dropshot): request completed latency_us = 102 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40855 req_id = 453cce84-d188-44f3-96dc-9d22bc64e539 response_code = 200 uri = /crucible/0/regions
202025-01-09T01:14:13.416ZINFOcrucible-agent (worker): region files created ok region = b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
212025-01-09T01:14:13.416ZINFOcrucible-agent (datafile): region b6a4d26c-f6af-4112-b32d-7ab5c1dda91d state: Requested -> Created
222025-01-09T01:14:13.416ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-01-09T01:14:13.417ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
242025-01-09T01:14:13.427ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
252025-01-09T01:14:13.443ZINFOcrucible-agent (worker): creating config property group
262025-01-09T01:14:13.446ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
272025-01-09T01:14:13.447ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
282025-01-09T01:14:13.447ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-01-09T01:14:13.447ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
302025-01-09T01:14:13.447ZINFOcrucible-agent (worker): commit
312025-01-09T01:14:13.453ZINFOcrucible-agent (worker): ok!
322025-01-09T01:14:13.457ZINFOcrucible-agent (worker): SMF ok!
332025-01-09T01:14:13.802ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40855 req_id = eb82e865-e749-438c-806b-6ef712125c74 response_code = 200 uri = /crucible/0/regions
342025-01-09T01:14:39.888ZINFOcrucible-agent (dropshot): request completed latency_us = 106 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40855 req_id = 24039133-7873-4453-9168-898383ecbabb response_code = 200 uri = /crucible/0/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
352025-01-09T01:14:39.891ZINFOcrucible-agent (datafile): path is "/data/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d"
362025-01-09T01:14:39.902ZINFOcrucible-agent (datafile): dataset is oxp_a132b3b6-342d-41c2-a6be-600f78f98f46/crucible/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
372025-01-09T01:14:39.913ZINFOcrucible-agent (datafile): region b6a4d26c-f6af-4112-b32d-7ab5c1dda91d state: Created -> Tombstoned
382025-01-09T01:14:39.913ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-01-09T01:14:39.913ZINFOcrucible-agent (dropshot): request completed latency_us = 21622 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:40855 req_id = ab9ad004-2f0a-490e-935d-a90b209e5325 response_code = 204 uri = /crucible/0/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
402025-01-09T01:14:39.917ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b6a4d26c-f6af-4112-b32d-7ab5c1dda91d (instance states: (Some(Online), None))
412025-01-09T01:14:39.917ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40855 req_id = f63d0316-af3c-4e1f-a321-e821971b0402 response_code = 200 uri = /crucible/0/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
422025-01-09T01:14:39.923ZINFOcrucible-agent (worker): SMF ok!
432025-01-09T01:14:39.934ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_a132b3b6-342d-41c2-a6be-600f78f98f46/crucible/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d" region = b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
442025-01-09T01:14:39.973ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40855 req_id = aca362bd-efdd-425e-ae9d-122d45400122 response_code = 200 uri = /crucible/0/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d
452025-01-09T01:14:39.984ZINFOcrucible-agent (datafile): region b6a4d26c-f6af-4112-b32d-7ab5c1dda91d state: Tombstoned -> Destroyed
462025-01-09T01:14:40.044ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40855 req_id = 45f12506-0afc-494f-8a74-5bee24f4c2b2 response_code = 200 uri = /crucible/0/regions/b6a4d26c-f6af-4112-b32d-7ab5c1dda91d