Max level shown:
12024-12-14T04:47:04.717ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:49893
22024-12-14T04:47:04.763ZINFOcrucible-agent (datafile): region 82835a92-d09b-4ded-895c-d06443923668 state: Requested
32024-12-14T04:47:04.768ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-14T04:47:04.773ZINFOcrucible-agent (dropshot): request completed latency_us = 17059 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49893 req_id = 4aa16836-842a-4f0e-84da-006c0fb4e218 response_code = 200 uri = /crucible/0/regions
52024-12-14T04:47:04.781ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b2611121-1765-43c3-8af4-2032359b2c55/crucible/regions/82835a92-d09b-4ded-895c-d06443923668
62024-12-14T04:47:04.781ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b2611121-1765-43c3-8af4-2032359b2c55/crucible/regions/82835a92-d09b-4ded-895c-d06443923668
72024-12-14T04:47:04.831ZINFOcrucible-agent (worker): creating region Region { id: RegionId("82835a92-d09b-4ded-895c-d06443923668"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/82835a92-d09b-4ded-895c-d06443923668" region = 82835a92-d09b-4ded-895c-d06443923668
82024-12-14T04:47:04.833ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "82835a92-d09b-4ded-895c-d06443923668" "--data" "/data/regions/82835a92-d09b-4ded-895c-d06443923668" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 82835a92-d09b-4ded-895c-d06443923668
92024-12-14T04:47:05.051ZINFOcrucible-agent (dropshot): request completed latency_us = 114 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49893 req_id = 0872c78e-3e8f-4889-b3c4-ff4b42ff655e response_code = 200 uri = /crucible/0/regions
102024-12-14T04:47:05.180ZINFOcrucible-agent (worker): region files created ok region = 82835a92-d09b-4ded-895c-d06443923668
112024-12-14T04:47:05.180ZINFOcrucible-agent (datafile): region 82835a92-d09b-4ded-895c-d06443923668 state: Requested -> Created
122024-12-14T04:47:05.180ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-12-14T04:47:05.180ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-82835a92-d09b-4ded-895c-d06443923668
142024-12-14T04:47:05.188ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-82835a92-d09b-4ded-895c-d06443923668
152024-12-14T04:47:05.203ZINFOcrucible-agent (worker): creating config property group
162024-12-14T04:47:05.207ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82835a92-d09b-4ded-895c-d06443923668
172024-12-14T04:47:05.207ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82835a92-d09b-4ded-895c-d06443923668
182024-12-14T04:47:05.207ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-12-14T04:47:05.207ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202024-12-14T04:47:05.208ZINFOcrucible-agent (worker): commit
212024-12-14T04:47:05.211ZINFOcrucible-agent (worker): ok!
222024-12-14T04:47:05.216ZINFOcrucible-agent (worker): SMF ok!
232024-12-14T04:47:05.486ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49893 req_id = a24d17eb-22bd-4a8a-ba1a-e01ef28dc0d3 response_code = 200 uri = /crucible/0/regions
242024-12-14T04:47:10.385ZINFOcrucible-agent (datafile): region 3a6b3006-3b63-449c-9d02-0d33003d89b6 state: Requested
252024-12-14T04:47:10.385ZINFOcrucible-agent (dropshot): request completed latency_us = 228 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49893 req_id = e47a4a5d-d6ea-42f1-8947-ddf6d9ea76fa response_code = 200 uri = /crucible/0/regions
262024-12-14T04:47:10.385ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272024-12-14T04:47:10.395ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b2611121-1765-43c3-8af4-2032359b2c55/crucible/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6
282024-12-14T04:47:10.395ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b2611121-1765-43c3-8af4-2032359b2c55/crucible/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6
292024-12-14T04:47:10.454ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3a6b3006-3b63-449c-9d02-0d33003d89b6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6" region = 3a6b3006-3b63-449c-9d02-0d33003d89b6
302024-12-14T04:47:10.454ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3a6b3006-3b63-449c-9d02-0d33003d89b6" "--data" "/data/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3a6b3006-3b63-449c-9d02-0d33003d89b6
312024-12-14T04:47:10.526ZINFOcrucible-agent (worker): region files created ok region = 3a6b3006-3b63-449c-9d02-0d33003d89b6
322024-12-14T04:47:10.526ZINFOcrucible-agent (datafile): region 3a6b3006-3b63-449c-9d02-0d33003d89b6 state: Requested -> Created
332024-12-14T04:47:10.526ZINFOcrucible-agent (worker): applying SMF actions post create...
342024-12-14T04:47:10.527ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3a6b3006-3b63-449c-9d02-0d33003d89b6
352024-12-14T04:47:10.530ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3a6b3006-3b63-449c-9d02-0d33003d89b6
362024-12-14T04:47:10.538ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49893 req_id = 767d5b5f-4dfb-436c-ace6-98a49032804e response_code = 200 uri = /crucible/0/regions
372024-12-14T04:47:10.538ZINFOcrucible-agent (worker): creating config property group
382024-12-14T04:47:10.542ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3a6b3006-3b63-449c-9d02-0d33003d89b6
392024-12-14T04:47:10.542ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6
402024-12-14T04:47:10.542ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412024-12-14T04:47:10.542ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
422024-12-14T04:47:10.542ZINFOcrucible-agent (worker): commit
432024-12-14T04:47:10.546ZINFOcrucible-agent (worker): ok!
442024-12-14T04:47:10.556ZINFOcrucible-agent (worker): SMF ok!
452024-12-14T04:47:37.028ZINFOcrucible-agent (dropshot): request completed latency_us = 112 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49893 req_id = 42745edb-46c5-4bd0-ae7c-652415af086e response_code = 200 uri = /crucible/0/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6
462024-12-14T04:47:37.032ZINFOcrucible-agent (datafile): path is "/data/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6"
472024-12-14T04:47:37.045ZINFOcrucible-agent (datafile): dataset is oxp_b2611121-1765-43c3-8af4-2032359b2c55/crucible/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6
482024-12-14T04:47:37.055ZINFOcrucible-agent (datafile): region 3a6b3006-3b63-449c-9d02-0d33003d89b6 state: Created -> Tombstoned
492024-12-14T04:47:37.055ZINFOcrucible-agent (worker): applying SMF actions before removal...
502024-12-14T04:47:37.055ZINFOcrucible-agent (dropshot): request completed latency_us = 23165 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:49893 req_id = f5e3fe29-3d31-4e0b-b589-15d2f345b805 response_code = 204 uri = /crucible/0/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6
512024-12-14T04:47:37.056ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3a6b3006-3b63-449c-9d02-0d33003d89b6 (instance states: (Some(Online), None))
522024-12-14T04:47:37.059ZINFOcrucible-agent (dropshot): request completed latency_us = 952 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49893 req_id = c8457978-4cb2-44ab-bd16-84d6cd25adce response_code = 200 uri = /crucible/0/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6
532024-12-14T04:47:37.062ZINFOcrucible-agent (worker): SMF ok!
542024-12-14T04:47:37.074ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b2611121-1765-43c3-8af4-2032359b2c55/crucible/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6" region = 3a6b3006-3b63-449c-9d02-0d33003d89b6
552024-12-14T04:47:37.125ZINFOcrucible-agent (datafile): region 3a6b3006-3b63-449c-9d02-0d33003d89b6 state: Tombstoned -> Destroyed
562024-12-14T04:47:37.209ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49893 req_id = bfb088cb-a387-4e23-9e07-deb4fc9f367c response_code = 200 uri = /crucible/0/regions/3a6b3006-3b63-449c-9d02-0d33003d89b6