Max level shown:
12024-04-29T22:45:19.160ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:33107
22024-04-29T22:45:19.232ZINFOcrucible-agent (datafile): region e61432d8-301c-468e-bdc8-bebaa69b6c91 state: Requested
32024-04-29T22:45:19.239ZINFOcrucible-agent (dropshot): request completed latency_us = 21249 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33107 req_id = 366f4ed3-f601-493b-ba73-1a0c43b21201 response_code = 200 uri = /crucible/0/regions
42024-04-29T22:45:19.239ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-04-29T22:45:19.250ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e3118907-da30-4e85-a767-c5a42a2e46ca/crucible/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91
62024-04-29T22:45:19.250ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e3118907-da30-4e85-a767-c5a42a2e46ca/crucible/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91
72024-04-29T22:45:19.307ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e61432d8-301c-468e-bdc8-bebaa69b6c91"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91" region = e61432d8-301c-468e-bdc8-bebaa69b6c91
82024-04-29T22:45:19.309ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e61432d8-301c-468e-bdc8-bebaa69b6c91" "--data" "/data/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e61432d8-301c-468e-bdc8-bebaa69b6c91
92024-04-29T22:45:19.376ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33107 req_id = 17b332fc-f47e-4bc5-90ad-98a59e671a13 response_code = 200 uri = /crucible/0/regions
102024-04-29T22:45:19.470ZINFOcrucible-agent (worker): region files created ok region = e61432d8-301c-468e-bdc8-bebaa69b6c91
112024-04-29T22:45:19.470ZINFOcrucible-agent (datafile): region e61432d8-301c-468e-bdc8-bebaa69b6c91 state: Requested -> Created
122024-04-29T22:45:19.470ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-04-29T22:45:19.473ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e61432d8-301c-468e-bdc8-bebaa69b6c91
142024-04-29T22:45:19.477ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e61432d8-301c-468e-bdc8-bebaa69b6c91
152024-04-29T22:45:19.491ZINFOcrucible-agent (worker): creating config property group
162024-04-29T22:45:19.494ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e61432d8-301c-468e-bdc8-bebaa69b6c91
172024-04-29T22:45:19.495ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91
182024-04-29T22:45:19.500ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-04-29T22:45:19.500ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202024-04-29T22:45:19.500ZINFOcrucible-agent (worker): commit
212024-04-29T22:45:19.508ZINFOcrucible-agent (worker): ok!
222024-04-29T22:45:19.511ZINFOcrucible-agent (worker): SMF ok!
232024-04-29T22:45:19.945ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33107 req_id = e3fef095-a2b9-407f-b11a-01c49e07636c response_code = 200 uri = /crucible/0/regions
242024-04-29T22:45:23.370ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:54891
252024-04-29T22:45:23.430ZINFOcrucible-agent (datafile): region d581cf34-df7e-4d3a-ab49-442c8986f0d0 state: Requested
262024-04-29T22:45:23.430ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272024-04-29T22:45:23.430ZINFOcrucible-agent (dropshot): request completed latency_us = 212 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54891 req_id = 0a103367-7cac-42bf-b4c1-ad0e5c9f4123 response_code = 200 uri = /crucible/0/regions
282024-04-29T22:45:23.440ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e3118907-da30-4e85-a767-c5a42a2e46ca/crucible/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0
292024-04-29T22:45:23.440ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e3118907-da30-4e85-a767-c5a42a2e46ca/crucible/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0
302024-04-29T22:45:23.509ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d581cf34-df7e-4d3a-ab49-442c8986f0d0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0" region = d581cf34-df7e-4d3a-ab49-442c8986f0d0
312024-04-29T22:45:23.509ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d581cf34-df7e-4d3a-ab49-442c8986f0d0" "--data" "/data/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d581cf34-df7e-4d3a-ab49-442c8986f0d0
322024-04-29T22:45:23.572ZINFOcrucible-agent (worker): region files created ok region = d581cf34-df7e-4d3a-ab49-442c8986f0d0
332024-04-29T22:45:23.572ZINFOcrucible-agent (datafile): region d581cf34-df7e-4d3a-ab49-442c8986f0d0 state: Requested -> Created
342024-04-29T22:45:23.572ZINFOcrucible-agent (worker): applying SMF actions post create...
352024-04-29T22:45:23.572ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d581cf34-df7e-4d3a-ab49-442c8986f0d0
362024-04-29T22:45:23.575ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d581cf34-df7e-4d3a-ab49-442c8986f0d0
372024-04-29T22:45:23.582ZINFOcrucible-agent (worker): creating config property group
382024-04-29T22:45:23.585ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d581cf34-df7e-4d3a-ab49-442c8986f0d0
392024-04-29T22:45:23.586ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0
402024-04-29T22:45:23.586ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412024-04-29T22:45:23.586ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
422024-04-29T22:45:23.586ZINFOcrucible-agent (worker): commit
432024-04-29T22:45:23.590ZINFOcrucible-agent (worker): ok!
442024-04-29T22:45:23.596ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91
452024-04-29T22:45:23.596ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
462024-04-29T22:45:23.596ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
472024-04-29T22:45:23.596ZINFOcrucible-agent (worker): reconfig required
482024-04-29T22:45:23.596ZINFOcrucible-agent (worker): using existing config property group
492024-04-29T22:45:23.596ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e61432d8-301c-468e-bdc8-bebaa69b6c91
502024-04-29T22:45:23.596ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91
512024-04-29T22:45:23.596ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522024-04-29T22:45:23.596ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
532024-04-29T22:45:23.596ZINFOcrucible-agent (worker): commit
542024-04-29T22:45:23.604ZINFOcrucible-agent (worker): ok!
552024-04-29T22:45:23.604ZINFOcrucible-agent (worker): SMF ok!
562024-04-29T22:45:23.711ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54891 req_id = 5f35608d-bed2-44b8-9d5d-d3b11871e152 response_code = 200 uri = /crucible/0/regions
572024-04-29T22:45:47.509ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:43763
582024-04-29T22:45:47.511ZINFOcrucible-agent (dropshot): request completed latency_us = 2276 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43763 req_id = 277a5d3d-7fa8-4f86-9cec-08c6beb6c690 response_code = 200 uri = /crucible/0/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0
592024-04-29T22:45:47.511ZINFOcrucible-agent (datafile): path is "/data/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0"
602024-04-29T22:45:47.522ZINFOcrucible-agent (datafile): dataset is oxp_e3118907-da30-4e85-a767-c5a42a2e46ca/crucible/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0
612024-04-29T22:45:47.530ZINFOcrucible-agent (datafile): region d581cf34-df7e-4d3a-ab49-442c8986f0d0 state: Created -> Tombstoned
622024-04-29T22:45:47.531ZINFOcrucible-agent (worker): applying SMF actions before removal...
632024-04-29T22:45:47.532ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d581cf34-df7e-4d3a-ab49-442c8986f0d0 (instance states: (Some(Online), None))
642024-04-29T22:45:47.533ZINFOcrucible-agent (dropshot): request completed latency_us = 21859 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:43763 req_id = 479c06bb-1da6-4d19-bd30-af331d02391f response_code = 204 uri = /crucible/0/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0
652024-04-29T22:45:47.533ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43763 req_id = be89682f-b2a7-4ed3-9269-1d96019ef0fa response_code = 200 uri = /crucible/0/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0
662024-04-29T22:45:47.536ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91
672024-04-29T22:45:47.536ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
682024-04-29T22:45:47.537ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
692024-04-29T22:45:47.537ZINFOcrucible-agent (worker): reconfig required
702024-04-29T22:45:47.537ZINFOcrucible-agent (worker): using existing config property group
712024-04-29T22:45:47.537ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e61432d8-301c-468e-bdc8-bebaa69b6c91
722024-04-29T22:45:47.537ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e61432d8-301c-468e-bdc8-bebaa69b6c91
732024-04-29T22:45:47.537ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
742024-04-29T22:45:47.537ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
752024-04-29T22:45:47.538ZINFOcrucible-agent (worker): commit
762024-04-29T22:45:47.542ZINFOcrucible-agent (worker): ok!
772024-04-29T22:45:47.542ZINFOcrucible-agent (worker): SMF ok!
782024-04-29T22:45:47.553ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_e3118907-da30-4e85-a767-c5a42a2e46ca/crucible/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0" region = d581cf34-df7e-4d3a-ab49-442c8986f0d0
792024-04-29T22:45:47.605ZINFOcrucible-agent (datafile): region d581cf34-df7e-4d3a-ab49-442c8986f0d0 state: Tombstoned -> Destroyed
802024-04-29T22:45:47.680ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43763 req_id = d3937e84-a152-42d2-ad05-34ddfc72425b response_code = 200 uri = /crucible/0/regions/d581cf34-df7e-4d3a-ab49-442c8986f0d0