Max level shown:
12024-08-16T21:30:14.148ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:51790
22024-08-16T21:30:14.153ZINFOcrucible-agent (datafile): region 187effd5-8738-44d8-a887-ed1e8768195d state: Requested
32024-08-16T21:30:14.156ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42024-08-16T21:30:14.156ZINFOcrucible-agent (dropshot): request completed latency_us = 3715 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:51790 req_id = a5eef0d5-2258-4e09-afb0-3ca1e5d6fa55 response_code = 200 uri = /crucible/0/regions
52024-08-16T21:30:14.165ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_c93a3bfd-6e14-4ab2-ba6c-749fd55ec56d/crucible/regions/187effd5-8738-44d8-a887-ed1e8768195d
62024-08-16T21:30:14.165ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_c93a3bfd-6e14-4ab2-ba6c-749fd55ec56d/crucible/regions/187effd5-8738-44d8-a887-ed1e8768195d
72024-08-16T21:30:14.221ZINFOcrucible-agent (worker): creating region Region { id: RegionId("187effd5-8738-44d8-a887-ed1e8768195d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/187effd5-8738-44d8-a887-ed1e8768195d" region = 187effd5-8738-44d8-a887-ed1e8768195d
82024-08-16T21:30:14.221ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "187effd5-8738-44d8-a887-ed1e8768195d" "--data" "/data/regions/187effd5-8738-44d8-a887-ed1e8768195d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 187effd5-8738-44d8-a887-ed1e8768195d
92024-08-16T21:30:14.334ZINFOcrucible-agent (worker): region files created ok region = 187effd5-8738-44d8-a887-ed1e8768195d
102024-08-16T21:30:14.334ZINFOcrucible-agent (datafile): region 187effd5-8738-44d8-a887-ed1e8768195d state: Requested -> Created
112024-08-16T21:30:14.334ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-08-16T21:30:14.335ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-187effd5-8738-44d8-a887-ed1e8768195d
132024-08-16T21:30:14.338ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-187effd5-8738-44d8-a887-ed1e8768195d
142024-08-16T21:30:14.348ZINFOcrucible-agent (worker): creating config property group
152024-08-16T21:30:14.351ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-187effd5-8738-44d8-a887-ed1e8768195d
162024-08-16T21:30:14.352ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/187effd5-8738-44d8-a887-ed1e8768195d
172024-08-16T21:30:14.352ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-08-16T21:30:14.352ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192024-08-16T21:30:14.352ZINFOcrucible-agent (worker): commit
202024-08-16T21:30:14.356ZINFOcrucible-agent (worker): ok!
212024-08-16T21:30:14.361ZINFOcrucible-agent (worker): SMF ok!
222024-08-16T21:30:14.469ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:51790 req_id = 62c412be-7fc3-42cd-9dde-c661c9f06ebf response_code = 200 uri = /crucible/0/regions
232024-08-16T21:30:14.743ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51790 req_id = 79fd1af2-7bb0-494c-85e6-5c8225d2d732 response_code = 200 uri = /crucible/0/regions/187effd5-8738-44d8-a887-ed1e8768195d
242024-08-16T21:30:14.745ZINFOcrucible-agent (datafile): path is "/data/regions/187effd5-8738-44d8-a887-ed1e8768195d"
252024-08-16T21:30:14.755ZINFOcrucible-agent (datafile): dataset is oxp_c93a3bfd-6e14-4ab2-ba6c-749fd55ec56d/crucible/regions/187effd5-8738-44d8-a887-ed1e8768195d
262024-08-16T21:30:14.763ZINFOcrucible-agent (datafile): region 187effd5-8738-44d8-a887-ed1e8768195d state: Created -> Tombstoned
272024-08-16T21:30:14.763ZINFOcrucible-agent (worker): applying SMF actions before removal...
282024-08-16T21:30:14.763ZINFOcrucible-agent (dropshot): request completed latency_us = 18074 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:51790 req_id = eaba454c-ae74-4342-bdcf-053601a4181a response_code = 204 uri = /crucible/0/regions/187effd5-8738-44d8-a887-ed1e8768195d
292024-08-16T21:30:14.764ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-187effd5-8738-44d8-a887-ed1e8768195d (instance states: (Some(Online), None))
302024-08-16T21:30:14.766ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51790 req_id = cee65fd7-4f05-4c4d-8541-0a93eb553362 response_code = 200 uri = /crucible/0/regions/187effd5-8738-44d8-a887-ed1e8768195d
312024-08-16T21:30:14.768ZINFOcrucible-agent (worker): SMF ok!
322024-08-16T21:30:14.778ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c93a3bfd-6e14-4ab2-ba6c-749fd55ec56d/crucible/regions/187effd5-8738-44d8-a887-ed1e8768195d" region = 187effd5-8738-44d8-a887-ed1e8768195d
332024-08-16T21:30:14.837ZINFOcrucible-agent (datafile): region 187effd5-8738-44d8-a887-ed1e8768195d state: Tombstoned -> Destroyed
342024-08-16T21:30:14.848ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51790 req_id = 394362b0-c1ca-43c3-939b-cc8f64ddc28f response_code = 200 uri = /crucible/0/regions/187effd5-8738-44d8-a887-ed1e8768195d
352024-08-16T21:35:56.979ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:64250
362024-08-16T21:35:56.980ZINFOcrucible-agent (datafile): region b8156b8a-8df6-4d6a-a3d7-18cef5a45159 state: Requested
372024-08-16T21:35:56.980ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
382024-08-16T21:35:56.980ZINFOcrucible-agent (dropshot): request completed latency_us = 653 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64250 req_id = 0bd255be-16ab-4615-a56a-b18ad5e5bbcc response_code = 200 uri = /crucible/0/regions
392024-08-16T21:35:56.990ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c93a3bfd-6e14-4ab2-ba6c-749fd55ec56d/crucible/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159
402024-08-16T21:35:56.990ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c93a3bfd-6e14-4ab2-ba6c-749fd55ec56d/crucible/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159
412024-08-16T21:35:57.068ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b8156b8a-8df6-4d6a-a3d7-18cef5a45159"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159" region = b8156b8a-8df6-4d6a-a3d7-18cef5a45159
422024-08-16T21:35:57.070ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b8156b8a-8df6-4d6a-a3d7-18cef5a45159" "--data" "/data/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b8156b8a-8df6-4d6a-a3d7-18cef5a45159
432024-08-16T21:35:57.293ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64250 req_id = dd1366b9-83a1-40a5-93b2-697d75303b15 response_code = 200 uri = /crucible/0/regions
442024-08-16T21:35:57.324ZINFOcrucible-agent (worker): region files created ok region = b8156b8a-8df6-4d6a-a3d7-18cef5a45159
452024-08-16T21:35:57.324ZINFOcrucible-agent (datafile): region b8156b8a-8df6-4d6a-a3d7-18cef5a45159 state: Requested -> Created
462024-08-16T21:35:57.324ZINFOcrucible-agent (worker): applying SMF actions post create...
472024-08-16T21:35:57.326ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b8156b8a-8df6-4d6a-a3d7-18cef5a45159
482024-08-16T21:35:57.335ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b8156b8a-8df6-4d6a-a3d7-18cef5a45159
492024-08-16T21:35:57.346ZINFOcrucible-agent (worker): creating config property group
502024-08-16T21:35:57.352ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b8156b8a-8df6-4d6a-a3d7-18cef5a45159
512024-08-16T21:35:57.352ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159
522024-08-16T21:35:57.352ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532024-08-16T21:35:57.352ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
542024-08-16T21:35:57.352ZINFOcrucible-agent (worker): commit
552024-08-16T21:35:57.356ZINFOcrucible-agent (worker): ok!
562024-08-16T21:35:57.363ZINFOcrucible-agent (worker): SMF ok!
572024-08-16T21:35:57.694ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64250 req_id = fc61d3d8-a807-4ba5-89ff-2c7dd5bab6d6 response_code = 200 uri = /crucible/0/regions
582024-08-16T21:36:22.099ZINFOcrucible-agent (dropshot): request completed latency_us = 505 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64250 req_id = 6d2cb0c1-1f8d-4b80-96e6-5e5311b640dd response_code = 200 uri = /crucible/0/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159
592024-08-16T21:36:22.102ZINFOcrucible-agent (datafile): path is "/data/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159"
602024-08-16T21:36:22.115ZINFOcrucible-agent (datafile): dataset is oxp_c93a3bfd-6e14-4ab2-ba6c-749fd55ec56d/crucible/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159
612024-08-16T21:36:22.124ZINFOcrucible-agent (datafile): region b8156b8a-8df6-4d6a-a3d7-18cef5a45159 state: Created -> Tombstoned
622024-08-16T21:36:22.125ZINFOcrucible-agent (worker): applying SMF actions before removal...
632024-08-16T21:36:22.125ZINFOcrucible-agent (dropshot): request completed latency_us = 22828 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:64250 req_id = d75e0063-f1e4-43b4-9666-e20fce8f1b31 response_code = 204 uri = /crucible/0/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159
642024-08-16T21:36:22.126ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b8156b8a-8df6-4d6a-a3d7-18cef5a45159 (instance states: (Some(Online), None))
652024-08-16T21:36:22.129ZINFOcrucible-agent (dropshot): request completed latency_us = 773 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64250 req_id = 0423cf6d-153d-4ca1-b49e-0f5a5d5efb42 response_code = 200 uri = /crucible/0/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159
662024-08-16T21:36:22.130ZINFOcrucible-agent (worker): SMF ok!
672024-08-16T21:36:22.140ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c93a3bfd-6e14-4ab2-ba6c-749fd55ec56d/crucible/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159" region = b8156b8a-8df6-4d6a-a3d7-18cef5a45159
682024-08-16T21:36:22.193ZINFOcrucible-agent (datafile): region b8156b8a-8df6-4d6a-a3d7-18cef5a45159 state: Tombstoned -> Destroyed
692024-08-16T21:36:22.264ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64250 req_id = 1a343cae-1243-4a19-ad1c-1997edff6469 response_code = 200 uri = /crucible/0/regions/b8156b8a-8df6-4d6a-a3d7-18cef5a45159