Max level shown:
12026-03-03T01:45:42.932ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:54843
22026-03-03T01:45:42.980ZINFOcrucible-agent (datafile): region e0864f77-c4d7-4759-94ec-a47d12f4e269 state: Requested
32026-03-03T01:45:42.983ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-03T01:45:42.983ZINFOcrucible-agent (dropshot): request completed latency_us = 19675 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54843 req_id = ed674df3-dbb0-4095-9995-4054360f2668 response_code = 200 uri = /crucible/0/regions
52026-03-03T01:45:42.993ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d2bf8b66-b3ac-4c40-8649-4e5dbbde6965/crucible/regions/e0864f77-c4d7-4759-94ec-a47d12f4e269
62026-03-03T01:45:42.993ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d2bf8b66-b3ac-4c40-8649-4e5dbbde6965/crucible/regions/e0864f77-c4d7-4759-94ec-a47d12f4e269
72026-03-03T01:45:43.044ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e0864f77-c4d7-4759-94ec-a47d12f4e269"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e0864f77-c4d7-4759-94ec-a47d12f4e269" region = e0864f77-c4d7-4759-94ec-a47d12f4e269
82026-03-03T01:45:43.047ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e0864f77-c4d7-4759-94ec-a47d12f4e269" "--data" "/data/regions/e0864f77-c4d7-4759-94ec-a47d12f4e269" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e0864f77-c4d7-4759-94ec-a47d12f4e269
92026-03-03T01:45:43.182ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54843 req_id = 4f74d31f-7dc8-4334-8f6c-039440535cd3 response_code = 200 uri = /crucible/0/regions
102026-03-03T01:45:43.395ZINFOcrucible-agent (worker): region files created ok region = e0864f77-c4d7-4759-94ec-a47d12f4e269
112026-03-03T01:45:43.395ZINFOcrucible-agent (datafile): region e0864f77-c4d7-4759-94ec-a47d12f4e269 state: Requested -> Created
122026-03-03T01:45:43.396ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-03T01:45:43.396ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e0864f77-c4d7-4759-94ec-a47d12f4e269
142026-03-03T01:45:43.406ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e0864f77-c4d7-4759-94ec-a47d12f4e269
152026-03-03T01:45:43.429ZINFOcrucible-agent (worker): creating config property group
162026-03-03T01:45:43.432ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e0864f77-c4d7-4759-94ec-a47d12f4e269
172026-03-03T01:45:43.433ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e0864f77-c4d7-4759-94ec-a47d12f4e269
182026-03-03T01:45:43.433ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-03-03T01:45:43.433ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202026-03-03T01:45:43.433ZINFOcrucible-agent (worker): commit
212026-03-03T01:45:43.437ZINFOcrucible-agent (worker): ok!
222026-03-03T01:45:43.441ZINFOcrucible-agent (worker): SMF ok!
232026-03-03T01:45:43.680ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54843 req_id = 22903835-63e3-4b1c-bc16-980ef4df10a4 response_code = 200 uri = /crucible/0/regions
242026-03-03T01:45:49.759ZINFOcrucible-agent (datafile): region 96381a5a-997f-469e-af44-90327b70dfe2 state: Requested
252026-03-03T01:45:49.760ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-03-03T01:45:49.760ZINFOcrucible-agent (dropshot): request completed latency_us = 236 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54843 req_id = d602de7f-8cd5-473d-8115-7859c53fe82f response_code = 200 uri = /crucible/0/regions
272026-03-03T01:45:49.766ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d2bf8b66-b3ac-4c40-8649-4e5dbbde6965/crucible/regions/96381a5a-997f-469e-af44-90327b70dfe2
282026-03-03T01:45:49.766ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d2bf8b66-b3ac-4c40-8649-4e5dbbde6965/crucible/regions/96381a5a-997f-469e-af44-90327b70dfe2
292026-03-03T01:45:49.808ZINFOcrucible-agent (worker): creating region Region { id: RegionId("96381a5a-997f-469e-af44-90327b70dfe2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/96381a5a-997f-469e-af44-90327b70dfe2" region = 96381a5a-997f-469e-af44-90327b70dfe2
302026-03-03T01:45:49.808ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "96381a5a-997f-469e-af44-90327b70dfe2" "--data" "/data/regions/96381a5a-997f-469e-af44-90327b70dfe2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 96381a5a-997f-469e-af44-90327b70dfe2
312026-03-03T01:45:49.887ZINFOcrucible-agent (worker): region files created ok region = 96381a5a-997f-469e-af44-90327b70dfe2
322026-03-03T01:45:49.887ZINFOcrucible-agent (datafile): region 96381a5a-997f-469e-af44-90327b70dfe2 state: Requested -> Created
332026-03-03T01:45:49.887ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-03-03T01:45:49.887ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-96381a5a-997f-469e-af44-90327b70dfe2
352026-03-03T01:45:49.891ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-96381a5a-997f-469e-af44-90327b70dfe2
362026-03-03T01:45:49.898ZINFOcrucible-agent (worker): creating config property group
372026-03-03T01:45:49.902ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-96381a5a-997f-469e-af44-90327b70dfe2
382026-03-03T01:45:49.902ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/96381a5a-997f-469e-af44-90327b70dfe2
392026-03-03T01:45:49.902ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-03-03T01:45:49.902ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
412026-03-03T01:45:49.902ZINFOcrucible-agent (worker): commit
422026-03-03T01:45:49.906ZINFOcrucible-agent (worker): ok!
432026-03-03T01:45:49.917ZINFOcrucible-agent (worker): SMF ok!
442026-03-03T01:45:49.976ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:54843 req_id = ad17428b-6cd2-4be3-9337-6cbc9b3b481e response_code = 200 uri = /crucible/0/regions
452026-03-03T01:46:15.200ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:54843 req_id = 57e213f4-ba4e-47fa-ae92-d7b57ee5b86a response_code = 200 uri = /crucible/0/regions/96381a5a-997f-469e-af44-90327b70dfe2
462026-03-03T01:46:15.203ZINFOcrucible-agent (datafile): path is "/data/regions/96381a5a-997f-469e-af44-90327b70dfe2"
472026-03-03T01:46:15.214ZINFOcrucible-agent (datafile): dataset is oxp_d2bf8b66-b3ac-4c40-8649-4e5dbbde6965/crucible/regions/96381a5a-997f-469e-af44-90327b70dfe2
482026-03-03T01:46:15.221ZINFOcrucible-agent (datafile): region 96381a5a-997f-469e-af44-90327b70dfe2 state: Created -> Tombstoned
492026-03-03T01:46:15.221ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-03-03T01:46:15.221ZINFOcrucible-agent (dropshot): request completed latency_us = 18284 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:54843 req_id = 02ec2366-5d2e-43f2-b0c0-3bc0cb69b8cd response_code = 204 uri = /crucible/0/regions/96381a5a-997f-469e-af44-90327b70dfe2
512026-03-03T01:46:15.222ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-96381a5a-997f-469e-af44-90327b70dfe2 (instance states: (Some(Online), None))
522026-03-03T01:46:15.224ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:54843 req_id = 8557fed4-a50e-4983-9be6-0587b157c424 response_code = 200 uri = /crucible/0/regions/96381a5a-997f-469e-af44-90327b70dfe2
532026-03-03T01:46:15.231ZINFOcrucible-agent (worker): SMF ok!
542026-03-03T01:46:15.239ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d2bf8b66-b3ac-4c40-8649-4e5dbbde6965/crucible/regions/96381a5a-997f-469e-af44-90327b70dfe2" region = 96381a5a-997f-469e-af44-90327b70dfe2
552026-03-03T01:46:15.295ZINFOcrucible-agent (datafile): region 96381a5a-997f-469e-af44-90327b70dfe2 state: Tombstoned -> Destroyed
562026-03-03T01:46:15.347ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:54843 req_id = 2d4f0593-f25a-4e95-8785-27bfff6d7dc9 response_code = 200 uri = /crucible/0/regions/96381a5a-997f-469e-af44-90327b70dfe2