Max level shown:
12024-12-21T07:54:45.512ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:36599
22024-12-21T07:54:45.512ZINFOcrucible-agent (datafile): region 6a5dda0e-91f8-4848-b9b0-bd3ce633de23 state: Requested
32024-12-21T07:54:45.513ZINFOcrucible-agent (dropshot): request completed latency_us = 882 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36599 req_id = 7c8ff00c-dd5d-4c20-92ea-c8f4c18d520c response_code = 200 uri = /crucible/0/regions
42024-12-21T07:54:45.513ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-12-21T07:54:45.523ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/6a5dda0e-91f8-4848-b9b0-bd3ce633de23
62024-12-21T07:54:45.523ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/6a5dda0e-91f8-4848-b9b0-bd3ce633de23
72024-12-21T07:54:45.574ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6a5dda0e-91f8-4848-b9b0-bd3ce633de23"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6a5dda0e-91f8-4848-b9b0-bd3ce633de23" region = 6a5dda0e-91f8-4848-b9b0-bd3ce633de23
82024-12-21T07:54:45.574ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6a5dda0e-91f8-4848-b9b0-bd3ce633de23" "--data" "/data/regions/6a5dda0e-91f8-4848-b9b0-bd3ce633de23" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6a5dda0e-91f8-4848-b9b0-bd3ce633de23
92024-12-21T07:54:45.694ZINFOcrucible-agent (worker): region files created ok region = 6a5dda0e-91f8-4848-b9b0-bd3ce633de23
102024-12-21T07:54:45.694ZINFOcrucible-agent (datafile): region 6a5dda0e-91f8-4848-b9b0-bd3ce633de23 state: Requested -> Created
112024-12-21T07:54:45.694ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-21T07:54:45.694ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6a5dda0e-91f8-4848-b9b0-bd3ce633de23
132024-12-21T07:54:45.701ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6a5dda0e-91f8-4848-b9b0-bd3ce633de23
142024-12-21T07:54:45.730ZINFOcrucible-agent (worker): creating config property group
152024-12-21T07:54:45.734ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6a5dda0e-91f8-4848-b9b0-bd3ce633de23
162024-12-21T07:54:45.734ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6a5dda0e-91f8-4848-b9b0-bd3ce633de23
172024-12-21T07:54:45.734ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-12-21T07:54:45.734ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192024-12-21T07:54:45.734ZINFOcrucible-agent (worker): commit
202024-12-21T07:54:45.738ZINFOcrucible-agent (worker): ok!
212024-12-21T07:54:45.748ZINFOcrucible-agent (worker): SMF ok!
222024-12-21T07:54:45.864ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36599 req_id = 4f0c37bd-f108-4d78-9348-a5ad3ac2e288 response_code = 200 uri = /crucible/0/regions
232024-12-21T07:54:47.002ZINFOcrucible-agent (dropshot): request completed latency_us = 2725 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36599 req_id = 25f86b7d-b87b-474e-842c-60d03571c3f4 response_code = 200 uri = /crucible/0/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b
242024-12-21T07:54:47.005ZINFOcrucible-agent (datafile): path is "/data/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b"
252024-12-21T07:54:47.015ZINFOcrucible-agent (datafile): dataset is oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b
262024-12-21T07:54:47.023ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b@9153956a-2838-449a-927f-2d8b9f6e2ea0
272024-12-21T07:54:47.023ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b", "9153956a-2838-449a-927f-2d8b9f6e2ea0"]
282024-12-21T07:54:47.034ZINFOcrucible-agent (dropshot): request completed latency_us = 28176 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36599 req_id = a6559640-3f0c-4b8c-be41-0975176df1b7 response_code = 200 uri = /crucible/0/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b/snapshots/9153956a-2838-449a-927f-2d8b9f6e2ea0
292024-12-21T07:54:47.037ZINFOcrucible-agent (datafile): path is "/data/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b"
302024-12-21T07:54:47.046ZINFOcrucible-agent (datafile): dataset is oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b
312024-12-21T07:54:47.053ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b@9153956a-2838-449a-927f-2d8b9f6e2ea0
322024-12-21T07:54:47.053ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b", "9153956a-2838-449a-927f-2d8b9f6e2ea0"]
332024-12-21T07:54:47.062ZINFOcrucible-agent (datafile): requesting running snapshot 87c77e8f-5875-453b-bbf9-50208f42ab0b-9153956a-2838-449a-927f-2d8b9f6e2ea0 state: Requested
342024-12-21T07:54:47.062ZINFOcrucible-agent (worker): applying SMF actions for region 87c77e8f-5875-453b-bbf9-50208f42ab0b running snapshot 9153956a-2838-449a-927f-2d8b9f6e2ea0 (state Requested)...
352024-12-21T07:54:47.062ZINFOcrucible-agent (dropshot): request completed latency_us = 24937 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36599 req_id = 5c63871a-9b51-46c3-bf97-880d17440fd1 response_code = 200 uri = /crucible/0/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b/snapshots/9153956a-2838-449a-927f-2d8b9f6e2ea0/run
362024-12-21T07:54:47.065ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-87c77e8f-5875-453b-bbf9-50208f42ab0b-9153956a-2838-449a-927f-2d8b9f6e2ea0
372024-12-21T07:54:47.075ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-87c77e8f-5875-453b-bbf9-50208f42ab0b-9153956a-2838-449a-927f-2d8b9f6e2ea0
382024-12-21T07:54:47.085ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-87c77e8f-5875-453b-bbf9-50208f42ab0b-9153956a-2838-449a-927f-2d8b9f6e2ea0
392024-12-21T07:54:47.085ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b/.zfs/snapshot/9153956a-2838-449a-927f-2d8b9f6e2ea0
402024-12-21T07:54:47.085ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-12-21T07:54:47.085ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-12-21T07:54:47.085ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432024-12-21T07:54:47.085ZINFOcrucible-agent (worker): commit
442024-12-21T07:54:47.089ZINFOcrucible-agent (worker): ok!
452024-12-21T07:54:47.093ZINFOcrucible-agent (worker): SMF ok!
462024-12-21T07:54:47.093ZINFOcrucible-agent (datafile): region 87c77e8f-5875-453b-bbf9-50208f42ab0b running snapshot 9153956a-2838-449a-927f-2d8b9f6e2ea0 state: Requested -> Created
472024-12-21T07:54:47.230ZINFOcrucible-agent (datafile): path is "/data/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b"
482024-12-21T07:54:47.239ZINFOcrucible-agent (datafile): dataset is oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b
492024-12-21T07:54:47.247ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b@9153956a-2838-449a-927f-2d8b9f6e2ea0
502024-12-21T07:54:47.247ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b", "9153956a-2838-449a-927f-2d8b9f6e2ea0"]
512024-12-21T07:54:47.255ZINFOcrucible-agent (dropshot): request completed latency_us = 25039 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36599 req_id = d7f64197-6f83-42a6-acf9-48ab075b3416 response_code = 200 uri = /crucible/0/regions/87c77e8f-5875-453b-bbf9-50208f42ab0b/snapshots/9153956a-2838-449a-927f-2d8b9f6e2ea0/run