Max level shown:
12026-10-20T23:01:18.380ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:55561
22026-10-20T23:01:18.380ZINFOcrucible-agent (datafile): region 94f82fac-0ac2-47f6-b5f8-4ece13754eb0 state: Requested
32026-10-20T23:01:18.381ZINFOcrucible-agent (dropshot): request completed latency_us = 704 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55561 req_id = bdb4aae7-2efa-42cc-b0d9-b56fed3573ca response_code = 200 uri = /crucible/0/regions
42026-10-20T23:01:18.381ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-10-20T23:01:18.388ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/94f82fac-0ac2-47f6-b5f8-4ece13754eb0
62026-10-20T23:01:18.388ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/94f82fac-0ac2-47f6-b5f8-4ece13754eb0
72026-10-20T23:01:18.439ZINFOcrucible-agent (worker): creating region Region { id: RegionId("94f82fac-0ac2-47f6-b5f8-4ece13754eb0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/94f82fac-0ac2-47f6-b5f8-4ece13754eb0" region = 94f82fac-0ac2-47f6-b5f8-4ece13754eb0
82026-10-20T23:01:18.439ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "94f82fac-0ac2-47f6-b5f8-4ece13754eb0" "--data" "/data/regions/94f82fac-0ac2-47f6-b5f8-4ece13754eb0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 94f82fac-0ac2-47f6-b5f8-4ece13754eb0
92026-10-20T23:01:18.510ZINFOcrucible-agent (worker): region files created ok region = 94f82fac-0ac2-47f6-b5f8-4ece13754eb0
102026-10-20T23:01:18.510ZINFOcrucible-agent (datafile): region 94f82fac-0ac2-47f6-b5f8-4ece13754eb0 state: Requested -> Created
112026-10-20T23:01:18.510ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-10-20T23:01:18.511ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-94f82fac-0ac2-47f6-b5f8-4ece13754eb0
132026-10-20T23:01:18.519ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-94f82fac-0ac2-47f6-b5f8-4ece13754eb0
142026-10-20T23:01:18.541ZINFOcrucible-agent (worker): creating config property group
152026-10-20T23:01:18.544ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-94f82fac-0ac2-47f6-b5f8-4ece13754eb0
162026-10-20T23:01:18.545ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/94f82fac-0ac2-47f6-b5f8-4ece13754eb0
172026-10-20T23:01:18.545ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-10-20T23:01:18.545ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192026-10-20T23:01:18.545ZINFOcrucible-agent (worker): commit
202026-10-20T23:01:18.548ZINFOcrucible-agent (worker): ok!
212026-10-20T23:01:18.554ZINFOcrucible-agent (worker): SMF ok!
222026-10-20T23:01:18.663ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55561 req_id = c22ffe2e-c016-4efb-b8b5-3a95a708d03b response_code = 200 uri = /crucible/0/regions
232026-10-20T23:01:19.768ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55561 req_id = 97d83ff5-32c4-4635-add8-06ae89ccd9a5 response_code = 200 uri = /crucible/0/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343
242026-10-20T23:01:19.779ZINFOcrucible-agent (datafile): path is "/data/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343"
252026-10-20T23:01:19.786ZINFOcrucible-agent (datafile): dataset is oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343
262026-10-20T23:01:19.793ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343@44faff4f-5220-43b7-a579-c354b8e050df
272026-10-20T23:01:19.793ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343", "44faff4f-5220-43b7-a579-c354b8e050df"]
282026-10-20T23:01:19.804ZINFOcrucible-agent (dropshot): request completed latency_us = 27824 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55561 req_id = d926636d-5491-4094-8391-1f6b212da044 response_code = 200 uri = /crucible/0/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343/snapshots/44faff4f-5220-43b7-a579-c354b8e050df
292026-10-20T23:01:19.809ZINFOcrucible-agent (datafile): path is "/data/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343"
302026-10-20T23:01:19.816ZINFOcrucible-agent (datafile): dataset is oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343
312026-10-20T23:01:19.821ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343@44faff4f-5220-43b7-a579-c354b8e050df
322026-10-20T23:01:19.821ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343", "44faff4f-5220-43b7-a579-c354b8e050df"]
332026-10-20T23:01:19.828ZINFOcrucible-agent (datafile): requesting running snapshot aeddca6c-71b1-46d2-b9b4-f6a15f9e3343-44faff4f-5220-43b7-a579-c354b8e050df state: Requested
342026-10-20T23:01:19.828ZINFOcrucible-agent (worker): applying SMF actions for region aeddca6c-71b1-46d2-b9b4-f6a15f9e3343 running snapshot 44faff4f-5220-43b7-a579-c354b8e050df (state Requested)...
352026-10-20T23:01:19.828ZINFOcrucible-agent (dropshot): request completed latency_us = 19091 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55561 req_id = 72cd8ff1-d10a-4aee-8dee-85d67a1fc540 response_code = 200 uri = /crucible/0/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343/snapshots/44faff4f-5220-43b7-a579-c354b8e050df/run
362026-10-20T23:01:19.831ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-aeddca6c-71b1-46d2-b9b4-f6a15f9e3343-44faff4f-5220-43b7-a579-c354b8e050df
372026-10-20T23:01:19.838ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-aeddca6c-71b1-46d2-b9b4-f6a15f9e3343-44faff4f-5220-43b7-a579-c354b8e050df
382026-10-20T23:01:19.849ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-aeddca6c-71b1-46d2-b9b4-f6a15f9e3343-44faff4f-5220-43b7-a579-c354b8e050df
392026-10-20T23:01:19.850ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343/.zfs/snapshot/44faff4f-5220-43b7-a579-c354b8e050df
402026-10-20T23:01:19.850ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-10-20T23:01:19.850ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-10-20T23:01:19.850ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432026-10-20T23:01:19.850ZINFOcrucible-agent (worker): commit
442026-10-20T23:01:19.853ZINFOcrucible-agent (worker): ok!
452026-10-20T23:01:19.857ZINFOcrucible-agent (worker): SMF ok!
462026-10-20T23:01:19.857ZINFOcrucible-agent (datafile): region aeddca6c-71b1-46d2-b9b4-f6a15f9e3343 running snapshot 44faff4f-5220-43b7-a579-c354b8e050df state: Requested -> Created
472026-10-20T23:01:19.982ZINFOcrucible-agent (datafile): path is "/data/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343"
482026-10-20T23:01:19.988ZINFOcrucible-agent (datafile): dataset is oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343
492026-10-20T23:01:19.994ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343@44faff4f-5220-43b7-a579-c354b8e050df
502026-10-20T23:01:19.994ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_46cf4401-45c3-4aac-974e-fdfb74fe8343/crucible/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343", "44faff4f-5220-43b7-a579-c354b8e050df"]
512026-10-20T23:01:20.000ZINFOcrucible-agent (dropshot): request completed latency_us = 18584 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55561 req_id = 2bad0948-85a4-4d66-bde1-8d560cf2412e response_code = 200 uri = /crucible/0/regions/aeddca6c-71b1-46d2-b9b4-f6a15f9e3343/snapshots/44faff4f-5220-43b7-a579-c354b8e050df/run