Max level shown:
12024-06-24T21:17:59.698ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:43155
22024-06-24T21:17:59.699ZINFOcrucible-agent (datafile): region 726f9f9f-2318-4adb-9d31-6d28241e9d1e state: Requested
32024-06-24T21:17:59.699ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-06-24T21:17:59.699ZINFOcrucible-agent (dropshot): request completed latency_us = 928 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43155 req_id = 7598ef5b-046c-4a55-9c40-a74ad0464a3e response_code = 200 uri = /crucible/0/regions
52024-06-24T21:17:59.710ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_42eb9015-c580-4876-8d36-12e983368fe9/crucible/regions/726f9f9f-2318-4adb-9d31-6d28241e9d1e
62024-06-24T21:17:59.710ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_42eb9015-c580-4876-8d36-12e983368fe9/crucible/regions/726f9f9f-2318-4adb-9d31-6d28241e9d1e
72024-06-24T21:17:59.788ZINFOcrucible-agent (worker): creating region Region { id: RegionId("726f9f9f-2318-4adb-9d31-6d28241e9d1e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/726f9f9f-2318-4adb-9d31-6d28241e9d1e" region = 726f9f9f-2318-4adb-9d31-6d28241e9d1e
82024-06-24T21:17:59.790ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "726f9f9f-2318-4adb-9d31-6d28241e9d1e" "--data" "/data/regions/726f9f9f-2318-4adb-9d31-6d28241e9d1e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 726f9f9f-2318-4adb-9d31-6d28241e9d1e
92024-06-24T21:17:59.870ZINFOcrucible-agent (worker): region files created ok region = 726f9f9f-2318-4adb-9d31-6d28241e9d1e
102024-06-24T21:17:59.870ZINFOcrucible-agent (datafile): region 726f9f9f-2318-4adb-9d31-6d28241e9d1e state: Requested -> Created
112024-06-24T21:17:59.870ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-06-24T21:17:59.871ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-726f9f9f-2318-4adb-9d31-6d28241e9d1e
132024-06-24T21:17:59.877ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-726f9f9f-2318-4adb-9d31-6d28241e9d1e
142024-06-24T21:17:59.895ZINFOcrucible-agent (worker): creating config property group
152024-06-24T21:17:59.898ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-726f9f9f-2318-4adb-9d31-6d28241e9d1e
162024-06-24T21:17:59.898ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/726f9f9f-2318-4adb-9d31-6d28241e9d1e
172024-06-24T21:17:59.898ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-06-24T21:17:59.898ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192024-06-24T21:17:59.898ZINFOcrucible-agent (worker): commit
202024-06-24T21:17:59.902ZINFOcrucible-agent (worker): ok!
212024-06-24T21:17:59.908ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa
222024-06-24T21:17:59.908ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
232024-06-24T21:17:59.908ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
242024-06-24T21:17:59.908ZINFOcrucible-agent (worker): reconfig required
252024-06-24T21:17:59.908ZINFOcrucible-agent (worker): using existing config property group
262024-06-24T21:17:59.909ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-db858034-6b14-47fc-b6e9-b00e071ec2fa
272024-06-24T21:17:59.909ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa
282024-06-24T21:17:59.909ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-06-24T21:17:59.909ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
302024-06-24T21:17:59.909ZINFOcrucible-agent (worker): commit
312024-06-24T21:17:59.919ZINFOcrucible-agent (worker): ok!
322024-06-24T21:17:59.919ZINFOcrucible-agent (worker): SMF ok!
332024-06-24T21:18:00.033ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43155 req_id = 52456a75-5cc5-4a52-991b-93c61ae268b4 response_code = 200 uri = /crucible/0/regions
342024-06-24T21:18:00.930ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:34760
352024-06-24T21:18:00.934ZINFOcrucible-agent (dropshot): request completed latency_us = 3640 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34760 req_id = 9862508f-b4f0-4f28-a5f3-45695cf6c472 response_code = 200 uri = /crucible/0/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa
362024-06-24T21:18:00.934ZINFOcrucible-agent (datafile): path is "/data/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa"
372024-06-24T21:18:00.943ZINFOcrucible-agent (datafile): dataset is oxp_42eb9015-c580-4876-8d36-12e983368fe9/crucible/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa
382024-06-24T21:18:00.952ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_42eb9015-c580-4876-8d36-12e983368fe9/crucible/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa@bc15a833-39b6-452c-9b7e-97484139099f
392024-06-24T21:18:00.952ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_42eb9015-c580-4876-8d36-12e983368fe9/crucible/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa", "bc15a833-39b6-452c-9b7e-97484139099f"]
402024-06-24T21:18:00.965ZINFOcrucible-agent (dropshot): request completed latency_us = 30957 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34760 req_id = 64fab390-94f2-4785-94dd-e5430da9d6a4 response_code = 200 uri = /crucible/0/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa/snapshots/bc15a833-39b6-452c-9b7e-97484139099f
412024-06-24T21:18:00.965ZINFOcrucible-agent (datafile): path is "/data/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa"
422024-06-24T21:18:00.974ZINFOcrucible-agent (datafile): dataset is oxp_42eb9015-c580-4876-8d36-12e983368fe9/crucible/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa
432024-06-24T21:18:00.982ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_42eb9015-c580-4876-8d36-12e983368fe9/crucible/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa@bc15a833-39b6-452c-9b7e-97484139099f
442024-06-24T21:18:00.982ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_42eb9015-c580-4876-8d36-12e983368fe9/crucible/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa", "bc15a833-39b6-452c-9b7e-97484139099f"]
452024-06-24T21:18:00.990ZINFOcrucible-agent (datafile): requesting running snapshot db858034-6b14-47fc-b6e9-b00e071ec2fa-bc15a833-39b6-452c-9b7e-97484139099f state: Requested
462024-06-24T21:18:00.990ZINFOcrucible-agent (worker): applying SMF actions for region db858034-6b14-47fc-b6e9-b00e071ec2fa running snapshot bc15a833-39b6-452c-9b7e-97484139099f (state Requested)...
472024-06-24T21:18:00.990ZINFOcrucible-agent (dropshot): request completed latency_us = 24781 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34760 req_id = 3207c53a-53f6-44b5-bc63-d693d1b241a7 response_code = 200 uri = /crucible/0/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa/snapshots/bc15a833-39b6-452c-9b7e-97484139099f/run
482024-06-24T21:18:00.992ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa
492024-06-24T21:18:00.992ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
502024-06-24T21:18:00.992ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
512024-06-24T21:18:00.992ZINFOcrucible-agent (worker): reconfig required
522024-06-24T21:18:00.992ZINFOcrucible-agent (worker): using existing config property group
532024-06-24T21:18:00.992ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-db858034-6b14-47fc-b6e9-b00e071ec2fa
542024-06-24T21:18:00.992ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa
552024-06-24T21:18:00.992ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
562024-06-24T21:18:00.992ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
572024-06-24T21:18:00.993ZINFOcrucible-agent (worker): commit
582024-06-24T21:18:00.997ZINFOcrucible-agent (worker): ok!
592024-06-24T21:18:00.998ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-db858034-6b14-47fc-b6e9-b00e071ec2fa-bc15a833-39b6-452c-9b7e-97484139099f
602024-06-24T21:18:01.003ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-db858034-6b14-47fc-b6e9-b00e071ec2fa-bc15a833-39b6-452c-9b7e-97484139099f
612024-06-24T21:18:01.014ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-db858034-6b14-47fc-b6e9-b00e071ec2fa-bc15a833-39b6-452c-9b7e-97484139099f
622024-06-24T21:18:01.014ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/db858034-6b14-47fc-b6e9-b00e071ec2fa/.zfs/snapshot/bc15a833-39b6-452c-9b7e-97484139099f
632024-06-24T21:18:01.014ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
642024-06-24T21:18:01.014ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-06-24T21:18:01.014ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
662024-06-24T21:18:01.014ZINFOcrucible-agent (worker): commit
672024-06-24T21:18:01.018ZINFOcrucible-agent (worker): ok!
682024-06-24T21:18:01.022ZINFOcrucible-agent (worker): SMF ok!
692024-06-24T21:18:01.022ZINFOcrucible-agent (datafile): region db858034-6b14-47fc-b6e9-b00e071ec2fa running snapshot bc15a833-39b6-452c-9b7e-97484139099f state: Requested -> Created