Max level shown:
12026-04-22T02:21:40.152ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:37541
22026-04-22T02:21:40.152ZINFOcrucible-agent (datafile): region 1bfd9794-5a23-4a5f-9d62-311c3315ae01 state: Requested
32026-04-22T02:21:40.153ZINFOcrucible-agent (dropshot): request completed latency_us = 926 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37541 req_id = bf2be51d-89fc-40c1-92d1-886d20db69a4 response_code = 200 uri = /crucible/0/regions
42026-04-22T02:21:40.153ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-04-22T02:21:40.162ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_00444b31-8643-4687-9437-4e8514239673/crucible/regions/1bfd9794-5a23-4a5f-9d62-311c3315ae01
62026-04-22T02:21:40.162ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_00444b31-8643-4687-9437-4e8514239673/crucible/regions/1bfd9794-5a23-4a5f-9d62-311c3315ae01
72026-04-22T02:21:40.217ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1bfd9794-5a23-4a5f-9d62-311c3315ae01"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1bfd9794-5a23-4a5f-9d62-311c3315ae01" region = 1bfd9794-5a23-4a5f-9d62-311c3315ae01
82026-04-22T02:21:40.217ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1bfd9794-5a23-4a5f-9d62-311c3315ae01" "--data" "/data/regions/1bfd9794-5a23-4a5f-9d62-311c3315ae01" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1bfd9794-5a23-4a5f-9d62-311c3315ae01
92026-04-22T02:21:40.295ZINFOcrucible-agent (worker): region files created ok region = 1bfd9794-5a23-4a5f-9d62-311c3315ae01
102026-04-22T02:21:40.295ZINFOcrucible-agent (datafile): region 1bfd9794-5a23-4a5f-9d62-311c3315ae01 state: Requested -> Created
112026-04-22T02:21:40.295ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-04-22T02:21:40.296ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1bfd9794-5a23-4a5f-9d62-311c3315ae01
132026-04-22T02:21:40.306ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1bfd9794-5a23-4a5f-9d62-311c3315ae01
142026-04-22T02:21:40.325ZINFOcrucible-agent (worker): creating config property group
152026-04-22T02:21:40.328ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1bfd9794-5a23-4a5f-9d62-311c3315ae01
162026-04-22T02:21:40.328ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1bfd9794-5a23-4a5f-9d62-311c3315ae01
172026-04-22T02:21:40.328ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-04-22T02:21:40.329ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192026-04-22T02:21:40.329ZINFOcrucible-agent (worker): commit
202026-04-22T02:21:40.332ZINFOcrucible-agent (worker): ok!
212026-04-22T02:21:40.336ZINFOcrucible-agent (worker): SMF ok!
222026-04-22T02:21:40.499ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37541 req_id = 6025b09e-51c4-44e2-9c6f-f2926c02d7b7 response_code = 200 uri = /crucible/0/regions
232026-04-22T02:21:47.020ZINFOcrucible-agent (datafile): region afcc479f-b1dc-43df-bfb3-d5ea9c9f8970 state: Requested
242026-04-22T02:21:47.020ZINFOcrucible-agent (dropshot): request completed latency_us = 218 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37541 req_id = 7e9b090b-7895-415a-89fa-457e373b4469 response_code = 200 uri = /crucible/0/regions
252026-04-22T02:21:47.020ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-04-22T02:21:47.026ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_00444b31-8643-4687-9437-4e8514239673/crucible/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
272026-04-22T02:21:47.026ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_00444b31-8643-4687-9437-4e8514239673/crucible/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
282026-04-22T02:21:47.083ZINFOcrucible-agent (worker): creating region Region { id: RegionId("afcc479f-b1dc-43df-bfb3-d5ea9c9f8970"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970" region = afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
292026-04-22T02:21:47.083ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "afcc479f-b1dc-43df-bfb3-d5ea9c9f8970" "--data" "/data/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
302026-04-22T02:21:47.205ZINFOcrucible-agent (worker): region files created ok region = afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
312026-04-22T02:21:47.205ZINFOcrucible-agent (datafile): region afcc479f-b1dc-43df-bfb3-d5ea9c9f8970 state: Requested -> Created
322026-04-22T02:21:47.205ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-04-22T02:21:47.210ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
342026-04-22T02:21:47.219ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
352026-04-22T02:21:47.226ZINFOcrucible-agent (worker): creating config property group
362026-04-22T02:21:47.229ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
372026-04-22T02:21:47.229ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
382026-04-22T02:21:47.229ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-04-22T02:21:47.229ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
402026-04-22T02:21:47.229ZINFOcrucible-agent (worker): commit
412026-04-22T02:21:47.232ZINFOcrucible-agent (worker): ok!
422026-04-22T02:21:47.237ZINFOcrucible-agent (worker): SMF ok!
432026-04-22T02:21:47.307ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37541 req_id = 90346ccc-8cb9-4224-a527-dff45e37e5a6 response_code = 200 uri = /crucible/0/regions
442026-04-22T02:22:12.026ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37541 req_id = 9b0b6dea-71d4-4878-9dd6-8cafa930cdba response_code = 200 uri = /crucible/0/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
452026-04-22T02:22:12.029ZINFOcrucible-agent (datafile): path is "/data/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970"
462026-04-22T02:22:12.040ZINFOcrucible-agent (datafile): dataset is oxp_00444b31-8643-4687-9437-4e8514239673/crucible/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
472026-04-22T02:22:12.047ZINFOcrucible-agent (datafile): region afcc479f-b1dc-43df-bfb3-d5ea9c9f8970 state: Created -> Tombstoned
482026-04-22T02:22:12.048ZINFOcrucible-agent (dropshot): request completed latency_us = 18816 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:37541 req_id = 454584fc-650b-4a8d-8d4d-d3f5cd294f02 response_code = 204 uri = /crucible/0/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
492026-04-22T02:22:12.048ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-04-22T02:22:12.049ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-afcc479f-b1dc-43df-bfb3-d5ea9c9f8970 (instance states: (Some(Online), None))
512026-04-22T02:22:12.051ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37541 req_id = 306263c4-092a-473d-823f-461bf3dd8dd8 response_code = 200 uri = /crucible/0/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
522026-04-22T02:22:12.059ZINFOcrucible-agent (worker): SMF ok!
532026-04-22T02:22:12.067ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_00444b31-8643-4687-9437-4e8514239673/crucible/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970" region = afcc479f-b1dc-43df-bfb3-d5ea9c9f8970
542026-04-22T02:22:12.124ZINFOcrucible-agent (datafile): region afcc479f-b1dc-43df-bfb3-d5ea9c9f8970 state: Tombstoned -> Destroyed
552026-04-22T02:22:12.166ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37541 req_id = 0d521892-8078-424c-81a8-1b72d7194bbe response_code = 200 uri = /crucible/0/regions/afcc479f-b1dc-43df-bfb3-d5ea9c9f8970