Max level shown:
12026-01-26T18:00:54.172ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:63467
22026-01-26T18:00:54.200ZINFOcrucible-agent (datafile): region e1872e75-cf9c-4e09-a91c-4f7f28afffc5 state: Requested
32026-01-26T18:00:54.202ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42026-01-26T18:00:54.202ZINFOcrucible-agent (dropshot): request completed latency_us = 14868 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63467 req_id = 0236b29f-46c7-4a9b-a943-25015003c648 response_code = 200 uri = /crucible/0/regions
52026-01-26T18:00:54.212ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_378712a7-af8d-465f-9b1c-17ec39927c98/crucible/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5
62026-01-26T18:00:54.212ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_378712a7-af8d-465f-9b1c-17ec39927c98/crucible/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5
72026-01-26T18:00:54.270ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e1872e75-cf9c-4e09-a91c-4f7f28afffc5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5" region = e1872e75-cf9c-4e09-a91c-4f7f28afffc5
82026-01-26T18:00:54.273ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e1872e75-cf9c-4e09-a91c-4f7f28afffc5" "--data" "/data/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = e1872e75-cf9c-4e09-a91c-4f7f28afffc5
92026-01-26T18:00:54.498ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63467 req_id = 8336e3a3-a46d-4b5b-bc81-ef082b0bb220 response_code = 200 uri = /crucible/0/regions
102026-01-26T18:00:54.602ZINFOcrucible-agent (worker): region files created ok region = e1872e75-cf9c-4e09-a91c-4f7f28afffc5
112026-01-26T18:00:54.602ZINFOcrucible-agent (datafile): region e1872e75-cf9c-4e09-a91c-4f7f28afffc5 state: Requested -> Created
122026-01-26T18:00:54.602ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-26T18:00:54.602ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e1872e75-cf9c-4e09-a91c-4f7f28afffc5
142026-01-26T18:00:54.607ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e1872e75-cf9c-4e09-a91c-4f7f28afffc5
152026-01-26T18:00:54.619ZINFOcrucible-agent (worker): creating config property group
162026-01-26T18:00:54.622ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e1872e75-cf9c-4e09-a91c-4f7f28afffc5
172026-01-26T18:00:54.623ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5
182026-01-26T18:00:54.623ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-01-26T18:00:54.623ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202026-01-26T18:00:54.623ZINFOcrucible-agent (worker): commit
212026-01-26T18:00:54.627ZINFOcrucible-agent (worker): ok!
222026-01-26T18:00:54.632ZINFOcrucible-agent (worker): SMF ok!
232026-01-26T18:00:54.834ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63467 req_id = 1055c8bf-20cf-4940-8e52-4aeb2a583e25 response_code = 200 uri = /crucible/0/regions
242026-01-26T18:00:55.584ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63467 req_id = c9a45b49-30ef-45ec-8f76-9626f112a6a1 response_code = 200 uri = /crucible/0/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5
252026-01-26T18:00:55.589ZINFOcrucible-agent (datafile): path is "/data/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5"
262026-01-26T18:00:55.597ZINFOcrucible-agent (datafile): dataset is oxp_378712a7-af8d-465f-9b1c-17ec39927c98/crucible/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5
272026-01-26T18:00:55.604ZINFOcrucible-agent (datafile): region e1872e75-cf9c-4e09-a91c-4f7f28afffc5 state: Created -> Tombstoned
282026-01-26T18:00:55.604ZINFOcrucible-agent (worker): applying SMF actions before removal...
292026-01-26T18:00:55.604ZINFOcrucible-agent (dropshot): request completed latency_us = 15219 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:63467 req_id = eaf9b235-9644-4655-a6db-0c154893751b response_code = 204 uri = /crucible/0/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5
302026-01-26T18:00:55.605ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e1872e75-cf9c-4e09-a91c-4f7f28afffc5 (instance states: (Some(Online), None))
312026-01-26T18:00:55.608ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63467 req_id = d5bc1f24-852c-4272-92aa-6f085e183648 response_code = 200 uri = /crucible/0/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5
322026-01-26T18:00:55.610ZINFOcrucible-agent (worker): SMF ok!
332026-01-26T18:00:55.617ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_378712a7-af8d-465f-9b1c-17ec39927c98/crucible/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5" region = e1872e75-cf9c-4e09-a91c-4f7f28afffc5
342026-01-26T18:00:55.686ZINFOcrucible-agent (datafile): region e1872e75-cf9c-4e09-a91c-4f7f28afffc5 state: Tombstoned -> Destroyed
352026-01-26T18:00:55.751ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63467 req_id = 2066da10-645a-4386-a74b-238bcf45e50d response_code = 200 uri = /crucible/0/regions/e1872e75-cf9c-4e09-a91c-4f7f28afffc5
362026-01-26T18:12:02.748ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:47433
372026-01-26T18:12:02.749ZINFOcrucible-agent (datafile): region 7816ae1e-45dd-4ceb-b715-534489c9f68f state: Requested
382026-01-26T18:12:02.749ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
392026-01-26T18:12:02.749ZINFOcrucible-agent (dropshot): request completed latency_us = 738 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47433 req_id = 0c44c94e-7ea4-4664-83f5-15e9917ee25b response_code = 200 uri = /crucible/0/regions
402026-01-26T18:12:02.760ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_378712a7-af8d-465f-9b1c-17ec39927c98/crucible/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f
412026-01-26T18:12:02.760ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_378712a7-af8d-465f-9b1c-17ec39927c98/crucible/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f
422026-01-26T18:12:02.818ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7816ae1e-45dd-4ceb-b715-534489c9f68f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f" region = 7816ae1e-45dd-4ceb-b715-534489c9f68f
432026-01-26T18:12:02.818ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7816ae1e-45dd-4ceb-b715-534489c9f68f" "--data" "/data/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7816ae1e-45dd-4ceb-b715-534489c9f68f
442026-01-26T18:12:02.950ZINFOcrucible-agent (worker): region files created ok region = 7816ae1e-45dd-4ceb-b715-534489c9f68f
452026-01-26T18:12:02.950ZINFOcrucible-agent (datafile): region 7816ae1e-45dd-4ceb-b715-534489c9f68f state: Requested -> Created
462026-01-26T18:12:02.950ZINFOcrucible-agent (worker): applying SMF actions post create...
472026-01-26T18:12:02.951ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7816ae1e-45dd-4ceb-b715-534489c9f68f
482026-01-26T18:12:02.962ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7816ae1e-45dd-4ceb-b715-534489c9f68f
492026-01-26T18:12:02.990ZINFOcrucible-agent (worker): creating config property group
502026-01-26T18:12:02.996ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7816ae1e-45dd-4ceb-b715-534489c9f68f
512026-01-26T18:12:02.997ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f
522026-01-26T18:12:02.997ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532026-01-26T18:12:02.997ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
542026-01-26T18:12:02.997ZINFOcrucible-agent (worker): commit
552026-01-26T18:12:03.008ZINFOcrucible-agent (worker): ok!
562026-01-26T18:12:03.019ZINFOcrucible-agent (worker): SMF ok!
572026-01-26T18:12:03.115ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47433 req_id = c6687ba4-d6dc-432f-a281-e1e184090545 response_code = 200 uri = /crucible/0/regions
582026-01-26T18:12:31.519ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47433 req_id = cd007e45-a5a5-4eb7-85da-f07f11106426 response_code = 200 uri = /crucible/0/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f
592026-01-26T18:12:31.521ZINFOcrucible-agent (datafile): path is "/data/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f"
602026-01-26T18:12:31.531ZINFOcrucible-agent (datafile): dataset is oxp_378712a7-af8d-465f-9b1c-17ec39927c98/crucible/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f
612026-01-26T18:12:31.537ZINFOcrucible-agent (datafile): region 7816ae1e-45dd-4ceb-b715-534489c9f68f state: Created -> Tombstoned
622026-01-26T18:12:31.537ZINFOcrucible-agent (worker): applying SMF actions before removal...
632026-01-26T18:12:31.537ZINFOcrucible-agent (dropshot): request completed latency_us = 16060 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:47433 req_id = b80ba2c3-2ba8-40f5-a71f-8b05376ea8f2 response_code = 204 uri = /crucible/0/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f
642026-01-26T18:12:31.539ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-7816ae1e-45dd-4ceb-b715-534489c9f68f (instance states: (Some(Online), None))
652026-01-26T18:12:31.541ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47433 req_id = 597597a3-b4c7-419c-a6f5-7ee70a29858d response_code = 200 uri = /crucible/0/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f
662026-01-26T18:12:31.548ZINFOcrucible-agent (worker): SMF ok!
672026-01-26T18:12:31.557ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_378712a7-af8d-465f-9b1c-17ec39927c98/crucible/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f" region = 7816ae1e-45dd-4ceb-b715-534489c9f68f
682026-01-26T18:12:31.615ZINFOcrucible-agent (datafile): region 7816ae1e-45dd-4ceb-b715-534489c9f68f state: Tombstoned -> Destroyed
692026-01-26T18:12:31.619ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47433 req_id = dbb4c3b8-99b3-403f-b643-23a32de27d8f response_code = 200 uri = /crucible/0/regions/7816ae1e-45dd-4ceb-b715-534489c9f68f