Max level shown:
12024-08-02T04:45:51.042ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:43268
22024-08-02T04:45:51.042ZINFOcrucible-agent (datafile): region 4c0587f9-860c-467e-84f7-de8db395c292 state: Requested
32024-08-02T04:45:51.043ZINFOcrucible-agent (dropshot): request completed latency_us = 212 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43268 req_id = e89965f1-cffc-4630-8374-ddf1fbf5def3 response_code = 200 uri = /crucible/0/regions
42024-08-02T04:45:51.043ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-08-02T04:45:51.051ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4c0587f9-860c-467e-84f7-de8db395c292
62024-08-02T04:45:51.051ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4c0587f9-860c-467e-84f7-de8db395c292
72024-08-02T04:45:51.102ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4c0587f9-860c-467e-84f7-de8db395c292"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4c0587f9-860c-467e-84f7-de8db395c292" region = 4c0587f9-860c-467e-84f7-de8db395c292
82024-08-02T04:45:51.104ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4c0587f9-860c-467e-84f7-de8db395c292" "--data" "/data/regions/4c0587f9-860c-467e-84f7-de8db395c292" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4c0587f9-860c-467e-84f7-de8db395c292
92024-08-02T04:45:51.192ZINFOcrucible-agent (worker): region files created ok region = 4c0587f9-860c-467e-84f7-de8db395c292
102024-08-02T04:45:51.192ZINFOcrucible-agent (datafile): region 4c0587f9-860c-467e-84f7-de8db395c292 state: Requested -> Created
112024-08-02T04:45:51.192ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-08-02T04:45:51.193ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4c0587f9-860c-467e-84f7-de8db395c292
132024-08-02T04:45:51.197ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4c0587f9-860c-467e-84f7-de8db395c292
142024-08-02T04:45:51.203ZINFOcrucible-agent (worker): creating config property group
152024-08-02T04:45:51.206ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4c0587f9-860c-467e-84f7-de8db395c292
162024-08-02T04:45:51.206ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4c0587f9-860c-467e-84f7-de8db395c292
172024-08-02T04:45:51.206ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-08-02T04:45:51.206ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192024-08-02T04:45:51.206ZINFOcrucible-agent (worker): commit
202024-08-02T04:45:51.210ZINFOcrucible-agent (worker): ok!
212024-08-02T04:45:51.214ZINFOcrucible-agent (worker): SMF ok!
222024-08-02T04:45:51.219ZINFOcrucible-agent (dropshot): request completed latency_us = 737 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43268 req_id = e1fe9654-81cb-4c63-83f6-5afe39842eba response_code = 200 uri = /crucible/0/regions
232024-08-02T04:51:14.713ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:58519
242024-08-02T04:51:14.713ZINFOcrucible-agent (datafile): region 4883f46d-fbd2-4aed-9e6d-76d3f6e23a61 state: Requested
252024-08-02T04:51:14.714ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262024-08-02T04:51:14.714ZINFOcrucible-agent (dropshot): request completed latency_us = 1065 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58519 req_id = df592827-836d-456d-a05e-4b92d38753e6 response_code = 200 uri = /crucible/0/regions
272024-08-02T04:51:14.724ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
282024-08-02T04:51:14.724ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
292024-08-02T04:51:14.799ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4883f46d-fbd2-4aed-9e6d-76d3f6e23a61"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4883f46d-fbd2-4aed-9e6d-76d3f6e23a61" region = 4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
302024-08-02T04:51:14.801ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4883f46d-fbd2-4aed-9e6d-76d3f6e23a61" "--data" "/data/regions/4883f46d-fbd2-4aed-9e6d-76d3f6e23a61" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
312024-08-02T04:51:14.988ZINFOcrucible-agent (worker): region files created ok region = 4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
322024-08-02T04:51:14.988ZINFOcrucible-agent (datafile): region 4883f46d-fbd2-4aed-9e6d-76d3f6e23a61 state: Requested -> Created
332024-08-02T04:51:14.988ZINFOcrucible-agent (worker): applying SMF actions post create...
342024-08-02T04:51:14.989ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
352024-08-02T04:51:15.001ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
362024-08-02T04:51:15.031ZINFOcrucible-agent (worker): creating config property group
372024-08-02T04:51:15.037ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
382024-08-02T04:51:15.037ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4883f46d-fbd2-4aed-9e6d-76d3f6e23a61
392024-08-02T04:51:15.037ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402024-08-02T04:51:15.037ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
412024-08-02T04:51:15.037ZINFOcrucible-agent (worker): commit
422024-08-02T04:51:15.046ZINFOcrucible-agent (worker): ok!
432024-08-02T04:51:15.059ZINFOcrucible-agent (worker): SMF ok!
442024-08-02T04:51:15.070ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58519 req_id = 395f5ead-b910-4baf-8c07-07bd4895c1a0 response_code = 200 uri = /crucible/0/regions
452024-08-02T04:51:16.140ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:53349
462024-08-02T04:51:16.140ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53349 req_id = 84cb29bd-3439-411c-944e-653ecf348ec0 response_code = 200 uri = /crucible/0/regions/4c0587f9-860c-467e-84f7-de8db395c292
472024-08-02T04:51:16.143ZINFOcrucible-agent (datafile): path is "/data/regions/4c0587f9-860c-467e-84f7-de8db395c292"
482024-08-02T04:51:16.152ZINFOcrucible-agent (datafile): dataset is oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4c0587f9-860c-467e-84f7-de8db395c292
492024-08-02T04:51:16.162ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4c0587f9-860c-467e-84f7-de8db395c292@d6bcc841-339f-4b07-af5f-1a9bec77f0b2
502024-08-02T04:51:16.162ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4c0587f9-860c-467e-84f7-de8db395c292", "d6bcc841-339f-4b07-af5f-1a9bec77f0b2"]
512024-08-02T04:51:16.180ZINFOcrucible-agent (dropshot): request completed latency_us = 39584 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53349 req_id = 61670ff1-60de-47d6-8c0a-5c18617a2134 response_code = 200 uri = /crucible/0/regions/4c0587f9-860c-467e-84f7-de8db395c292/snapshots/d6bcc841-339f-4b07-af5f-1a9bec77f0b2
522024-08-02T04:51:16.180ZINFOcrucible-agent (datafile): path is "/data/regions/4c0587f9-860c-467e-84f7-de8db395c292"
532024-08-02T04:51:16.189ZINFOcrucible-agent (datafile): dataset is oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4c0587f9-860c-467e-84f7-de8db395c292
542024-08-02T04:51:16.198ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4c0587f9-860c-467e-84f7-de8db395c292@d6bcc841-339f-4b07-af5f-1a9bec77f0b2
552024-08-02T04:51:16.198ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6cc68c44-fbce-427c-b7a5-61f5beee62e6/crucible/regions/4c0587f9-860c-467e-84f7-de8db395c292", "d6bcc841-339f-4b07-af5f-1a9bec77f0b2"]
562024-08-02T04:51:16.206ZINFOcrucible-agent (datafile): requesting running snapshot 4c0587f9-860c-467e-84f7-de8db395c292-d6bcc841-339f-4b07-af5f-1a9bec77f0b2 state: Requested
572024-08-02T04:51:16.206ZINFOcrucible-agent (worker): applying SMF actions for region 4c0587f9-860c-467e-84f7-de8db395c292 running snapshot d6bcc841-339f-4b07-af5f-1a9bec77f0b2 (state Requested)...
582024-08-02T04:51:16.206ZINFOcrucible-agent (dropshot): request completed latency_us = 26558 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53349 req_id = b4a399e7-f9c5-4438-b364-4681f6ea60f8 response_code = 200 uri = /crucible/0/regions/4c0587f9-860c-467e-84f7-de8db395c292/snapshots/d6bcc841-339f-4b07-af5f-1a9bec77f0b2/run
592024-08-02T04:51:16.209ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-4c0587f9-860c-467e-84f7-de8db395c292-d6bcc841-339f-4b07-af5f-1a9bec77f0b2
602024-08-02T04:51:16.215ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-4c0587f9-860c-467e-84f7-de8db395c292-d6bcc841-339f-4b07-af5f-1a9bec77f0b2
612024-08-02T04:51:16.243ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-4c0587f9-860c-467e-84f7-de8db395c292-d6bcc841-339f-4b07-af5f-1a9bec77f0b2
622024-08-02T04:51:16.243ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4c0587f9-860c-467e-84f7-de8db395c292/.zfs/snapshot/d6bcc841-339f-4b07-af5f-1a9bec77f0b2
632024-08-02T04:51:16.243ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
642024-08-02T04:51:16.243ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-08-02T04:51:16.243ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
662024-08-02T04:51:16.243ZINFOcrucible-agent (worker): commit
672024-08-02T04:51:16.254ZINFOcrucible-agent (worker): ok!
682024-08-02T04:51:16.263ZINFOcrucible-agent (worker): SMF ok!
692024-08-02T04:51:16.263ZINFOcrucible-agent (datafile): region 4c0587f9-860c-467e-84f7-de8db395c292 running snapshot d6bcc841-339f-4b07-af5f-1a9bec77f0b2 state: Requested -> Created