Max level shown:
12025-12-18T04:05:09.381ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:55765
22025-12-18T04:05:09.431ZINFOcrucible-agent (datafile): region 2bca7302-7da2-402a-baa5-a39867458a73 state: Requested
32025-12-18T04:05:09.434ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-18T04:05:09.434ZINFOcrucible-agent (dropshot): request completed latency_us = 19745 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55765 req_id = ebde692a-cdf9-4805-a8ed-a677afce6d76 response_code = 200 uri = /crucible/0/regions
52025-12-18T04:05:09.445ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_08876a06-275b-4b11-8a42-ec8ae1d6fd26/crucible/regions/2bca7302-7da2-402a-baa5-a39867458a73
62025-12-18T04:05:09.445ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_08876a06-275b-4b11-8a42-ec8ae1d6fd26/crucible/regions/2bca7302-7da2-402a-baa5-a39867458a73
72025-12-18T04:05:09.491ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2bca7302-7da2-402a-baa5-a39867458a73"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2bca7302-7da2-402a-baa5-a39867458a73" region = 2bca7302-7da2-402a-baa5-a39867458a73
82025-12-18T04:05:09.493ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2bca7302-7da2-402a-baa5-a39867458a73" "--data" "/data/regions/2bca7302-7da2-402a-baa5-a39867458a73" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2bca7302-7da2-402a-baa5-a39867458a73
92025-12-18T04:05:09.705ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55765 req_id = 9ff0b70f-c429-4200-90c7-ddb429d49fdd response_code = 200 uri = /crucible/0/regions
102025-12-18T04:05:09.876ZINFOcrucible-agent (worker): region files created ok region = 2bca7302-7da2-402a-baa5-a39867458a73
112025-12-18T04:05:09.876ZINFOcrucible-agent (datafile): region 2bca7302-7da2-402a-baa5-a39867458a73 state: Requested -> Created
122025-12-18T04:05:09.876ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-18T04:05:09.876ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2bca7302-7da2-402a-baa5-a39867458a73
142025-12-18T04:05:09.889ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2bca7302-7da2-402a-baa5-a39867458a73
152025-12-18T04:05:09.909ZINFOcrucible-agent (worker): creating config property group
162025-12-18T04:05:09.912ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2bca7302-7da2-402a-baa5-a39867458a73
172025-12-18T04:05:09.913ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2bca7302-7da2-402a-baa5-a39867458a73
182025-12-18T04:05:09.913ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-18T04:05:09.913ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202025-12-18T04:05:09.913ZINFOcrucible-agent (worker): commit
212025-12-18T04:05:09.916ZINFOcrucible-agent (worker): ok!
222025-12-18T04:05:09.920ZINFOcrucible-agent (worker): SMF ok!
232025-12-18T04:05:10.419ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55765 req_id = 0120c53d-3454-4f60-93da-e06e9bac29bb response_code = 200 uri = /crucible/0/regions
242025-12-18T04:05:16.161ZINFOcrucible-agent (datafile): region 98373c06-082e-4123-adc9-b364c46e88cd state: Requested
252025-12-18T04:05:16.161ZINFOcrucible-agent (dropshot): request completed latency_us = 279 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55765 req_id = 2843c405-02be-4048-8a1e-571d1e2114c5 response_code = 200 uri = /crucible/0/regions
262025-12-18T04:05:16.161ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-12-18T04:05:16.167ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_08876a06-275b-4b11-8a42-ec8ae1d6fd26/crucible/regions/98373c06-082e-4123-adc9-b364c46e88cd
282025-12-18T04:05:16.167ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_08876a06-275b-4b11-8a42-ec8ae1d6fd26/crucible/regions/98373c06-082e-4123-adc9-b364c46e88cd
292025-12-18T04:05:16.217ZINFOcrucible-agent (worker): creating region Region { id: RegionId("98373c06-082e-4123-adc9-b364c46e88cd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/98373c06-082e-4123-adc9-b364c46e88cd" region = 98373c06-082e-4123-adc9-b364c46e88cd
302025-12-18T04:05:16.217ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "98373c06-082e-4123-adc9-b364c46e88cd" "--data" "/data/regions/98373c06-082e-4123-adc9-b364c46e88cd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 98373c06-082e-4123-adc9-b364c46e88cd
312025-12-18T04:05:16.299ZINFOcrucible-agent (worker): region files created ok region = 98373c06-082e-4123-adc9-b364c46e88cd
322025-12-18T04:05:16.299ZINFOcrucible-agent (datafile): region 98373c06-082e-4123-adc9-b364c46e88cd state: Requested -> Created
332025-12-18T04:05:16.299ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-12-18T04:05:16.303ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-98373c06-082e-4123-adc9-b364c46e88cd
352025-12-18T04:05:16.306ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-98373c06-082e-4123-adc9-b364c46e88cd
362025-12-18T04:05:16.313ZINFOcrucible-agent (worker): creating config property group
372025-12-18T04:05:16.316ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-98373c06-082e-4123-adc9-b364c46e88cd
382025-12-18T04:05:16.317ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/98373c06-082e-4123-adc9-b364c46e88cd
392025-12-18T04:05:16.317ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-12-18T04:05:16.317ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412025-12-18T04:05:16.317ZINFOcrucible-agent (worker): commit
422025-12-18T04:05:16.321ZINFOcrucible-agent (worker): ok!
432025-12-18T04:05:16.325ZINFOcrucible-agent (worker): SMF ok!
442025-12-18T04:05:16.426ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55765 req_id = 5907824a-6f00-4994-bb38-1422a1818b54 response_code = 200 uri = /crucible/0/regions
452025-12-18T04:05:42.628ZINFOcrucible-agent (dropshot): request completed latency_us = 98 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55765 req_id = 5f0414c8-2298-456a-b7b7-dae132ea1b2b response_code = 200 uri = /crucible/0/regions/98373c06-082e-4123-adc9-b364c46e88cd
462025-12-18T04:05:42.632ZINFOcrucible-agent (datafile): path is "/data/regions/98373c06-082e-4123-adc9-b364c46e88cd"
472025-12-18T04:05:42.643ZINFOcrucible-agent (datafile): dataset is oxp_08876a06-275b-4b11-8a42-ec8ae1d6fd26/crucible/regions/98373c06-082e-4123-adc9-b364c46e88cd
482025-12-18T04:05:42.650ZINFOcrucible-agent (datafile): region 98373c06-082e-4123-adc9-b364c46e88cd state: Created -> Tombstoned
492025-12-18T04:05:42.651ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-12-18T04:05:42.651ZINFOcrucible-agent (dropshot): request completed latency_us = 19108 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:55765 req_id = 3d06a0af-aa6b-47d8-ab07-cc9d7277763c response_code = 204 uri = /crucible/0/regions/98373c06-082e-4123-adc9-b364c46e88cd
512025-12-18T04:05:42.652ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-98373c06-082e-4123-adc9-b364c46e88cd (instance states: (Some(Online), None))
522025-12-18T04:05:42.654ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55765 req_id = 949f0af9-d702-4b08-9eb0-7aa7637bbec9 response_code = 200 uri = /crucible/0/regions/98373c06-082e-4123-adc9-b364c46e88cd
532025-12-18T04:05:42.665ZINFOcrucible-agent (worker): SMF ok!
542025-12-18T04:05:42.674ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_08876a06-275b-4b11-8a42-ec8ae1d6fd26/crucible/regions/98373c06-082e-4123-adc9-b364c46e88cd" region = 98373c06-082e-4123-adc9-b364c46e88cd
552025-12-18T04:05:42.729ZINFOcrucible-agent (datafile): region 98373c06-082e-4123-adc9-b364c46e88cd state: Tombstoned -> Destroyed
562025-12-18T04:05:42.806ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55765 req_id = c881eff4-fb2b-4064-9b45-4119ce15472d response_code = 200 uri = /crucible/0/regions/98373c06-082e-4123-adc9-b364c46e88cd