Max level shown:
12026-01-02T05:16:42.430ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:56626
22026-01-02T05:16:42.431ZINFOcrucible-agent (datafile): region 2fa96a6b-3bff-4a38-82e8-cd6b348c610e state: Requested
32026-01-02T05:16:42.433ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-02T05:16:42.433ZINFOcrucible-agent (dropshot): request completed latency_us = 1978 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56626 req_id = 5248cb3e-6dcd-4bbc-bed2-a70b781bd1c4 response_code = 200 uri = /crucible/0/regions
52026-01-02T05:16:42.443ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/2fa96a6b-3bff-4a38-82e8-cd6b348c610e
62026-01-02T05:16:42.443ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/2fa96a6b-3bff-4a38-82e8-cd6b348c610e
72026-01-02T05:16:42.520ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2fa96a6b-3bff-4a38-82e8-cd6b348c610e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2fa96a6b-3bff-4a38-82e8-cd6b348c610e" region = 2fa96a6b-3bff-4a38-82e8-cd6b348c610e
82026-01-02T05:16:42.521ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2fa96a6b-3bff-4a38-82e8-cd6b348c610e" "--data" "/data/regions/2fa96a6b-3bff-4a38-82e8-cd6b348c610e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2fa96a6b-3bff-4a38-82e8-cd6b348c610e
92026-01-02T05:16:42.575ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56626 req_id = 914dea00-2af3-4f4f-a3cd-28d4ddbd8f88 response_code = 200 uri = /crucible/0/regions
102026-01-02T05:16:42.627ZINFOcrucible-agent (worker): region files created ok region = 2fa96a6b-3bff-4a38-82e8-cd6b348c610e
112026-01-02T05:16:42.627ZINFOcrucible-agent (datafile): region 2fa96a6b-3bff-4a38-82e8-cd6b348c610e state: Requested -> Created
122026-01-02T05:16:42.627ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-02T05:16:42.628ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2fa96a6b-3bff-4a38-82e8-cd6b348c610e
142026-01-02T05:16:42.640ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2fa96a6b-3bff-4a38-82e8-cd6b348c610e
152026-01-02T05:16:42.668ZINFOcrucible-agent (worker): creating config property group
162026-01-02T05:16:42.674ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2fa96a6b-3bff-4a38-82e8-cd6b348c610e
172026-01-02T05:16:42.674ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2fa96a6b-3bff-4a38-82e8-cd6b348c610e
182026-01-02T05:16:42.674ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-01-02T05:16:42.674ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202026-01-02T05:16:42.675ZINFOcrucible-agent (worker): commit
212026-01-02T05:16:42.680ZINFOcrucible-agent (worker): ok!
222026-01-02T05:16:42.703ZINFOcrucible-agent (worker): SMF ok!
232026-01-02T05:16:43.210ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56626 req_id = 8bd3e05d-a8e7-4b70-b757-c1f4184e6aa2 response_code = 200 uri = /crucible/0/regions
242026-01-02T05:16:43.910ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:56626 req_id = a85048c6-cf29-4f20-9f14-27cc771e8527 response_code = 200 uri = /crucible/0/regions/a41c5107-a0e1-4ce0-968f-475f9668541c
252026-01-02T05:16:43.915ZINFOcrucible-agent (datafile): path is "/data/regions/a41c5107-a0e1-4ce0-968f-475f9668541c"
262026-01-02T05:16:43.922ZINFOcrucible-agent (datafile): dataset is oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c
272026-01-02T05:16:43.929ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c@0b6864da-4436-4960-96f4-26b475aedaba
282026-01-02T05:16:43.929ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c", "0b6864da-4436-4960-96f4-26b475aedaba"]
292026-01-02T05:16:43.938ZINFOcrucible-agent (dropshot): request completed latency_us = 22768 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:56626 req_id = b4303c96-4ae1-466f-a405-fb2429c2f34b response_code = 200 uri = /crucible/0/regions/a41c5107-a0e1-4ce0-968f-475f9668541c/snapshots/0b6864da-4436-4960-96f4-26b475aedaba
302026-01-02T05:16:43.944ZINFOcrucible-agent (datafile): path is "/data/regions/a41c5107-a0e1-4ce0-968f-475f9668541c"
312026-01-02T05:16:43.950ZINFOcrucible-agent (datafile): dataset is oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c
322026-01-02T05:16:43.956ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c@0b6864da-4436-4960-96f4-26b475aedaba
332026-01-02T05:16:43.956ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c", "0b6864da-4436-4960-96f4-26b475aedaba"]
342026-01-02T05:16:43.964ZINFOcrucible-agent (datafile): requesting running snapshot a41c5107-a0e1-4ce0-968f-475f9668541c-0b6864da-4436-4960-96f4-26b475aedaba state: Requested
352026-01-02T05:16:43.964ZINFOcrucible-agent (dropshot): request completed latency_us = 19931 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56626 req_id = 53d81b28-963e-4c4f-805d-7c2d4a9b5bbc response_code = 200 uri = /crucible/0/regions/a41c5107-a0e1-4ce0-968f-475f9668541c/snapshots/0b6864da-4436-4960-96f4-26b475aedaba/run
362026-01-02T05:16:43.964ZINFOcrucible-agent (worker): applying SMF actions for region a41c5107-a0e1-4ce0-968f-475f9668541c running snapshot 0b6864da-4436-4960-96f4-26b475aedaba (state Requested)...
372026-01-02T05:16:43.969ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a41c5107-a0e1-4ce0-968f-475f9668541c-0b6864da-4436-4960-96f4-26b475aedaba
382026-01-02T05:16:43.976ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a41c5107-a0e1-4ce0-968f-475f9668541c-0b6864da-4436-4960-96f4-26b475aedaba
392026-01-02T05:16:43.988ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a41c5107-a0e1-4ce0-968f-475f9668541c-0b6864da-4436-4960-96f4-26b475aedaba
402026-01-02T05:16:43.988ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a41c5107-a0e1-4ce0-968f-475f9668541c/.zfs/snapshot/0b6864da-4436-4960-96f4-26b475aedaba
412026-01-02T05:16:43.988ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-01-02T05:16:43.988ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-01-02T05:16:43.988ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
442026-01-02T05:16:43.988ZINFOcrucible-agent (worker): commit
452026-01-02T05:16:43.992ZINFOcrucible-agent (worker): ok!
462026-01-02T05:16:43.997ZINFOcrucible-agent (worker): SMF ok!
472026-01-02T05:16:43.997ZINFOcrucible-agent (datafile): region a41c5107-a0e1-4ce0-968f-475f9668541c running snapshot 0b6864da-4436-4960-96f4-26b475aedaba state: Requested -> Created
482026-01-02T05:16:44.151ZINFOcrucible-agent (datafile): path is "/data/regions/a41c5107-a0e1-4ce0-968f-475f9668541c"
492026-01-02T05:16:44.159ZINFOcrucible-agent (datafile): dataset is oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c
502026-01-02T05:16:44.166ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c@0b6864da-4436-4960-96f4-26b475aedaba
512026-01-02T05:16:44.166ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a15e2c29-511d-4a61-977d-660add0d0931/crucible/regions/a41c5107-a0e1-4ce0-968f-475f9668541c", "0b6864da-4436-4960-96f4-26b475aedaba"]
522026-01-02T05:16:44.173ZINFOcrucible-agent (dropshot): request completed latency_us = 21796 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56626 req_id = 16eca7f4-1b30-48f2-9936-08a364c3699a response_code = 200 uri = /crucible/0/regions/a41c5107-a0e1-4ce0-968f-475f9668541c/snapshots/0b6864da-4436-4960-96f4-26b475aedaba/run