Max level shown:
1 [ Jul 6 00:07:50 Enabled. ]
2 [ Jul 6 00:07:50 Rereading configuration. ]
3 [ Jul 6 00:07:52 Rereading configuration. ]
4 [ Jul 6 00:07:55 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-06T00:07:55.104ZINFOcrucible-agent: dataset: "oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible"
72024-07-06T00:07:55.112ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-07-06T00:07:55.112ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-06T00:07:55.179ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-06T00:07:55.331ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-07-06T00:09:08.175ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:54427
122024-07-06T00:09:08.187ZINFOcrucible-agent (datafile): region 52a81213-76b6-4fd9-ac3b-2592477f5aa0 state: Requested
132024-07-06T00:09:08.193ZINFOcrucible-agent (dropshot): request completed latency_us = 8199 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54427 req_id = 42c95c21-5fb3-4d96-90bf-d8c2fbdce2c4 response_code = 200 uri = /crucible/0/regions
142024-07-06T00:09:08.193ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-07-06T00:09:08.201ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0
162024-07-06T00:09:08.201ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0
172024-07-06T00:09:08.243ZINFOcrucible-agent (worker): creating region Region { id: RegionId("52a81213-76b6-4fd9-ac3b-2592477f5aa0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0" region = 52a81213-76b6-4fd9-ac3b-2592477f5aa0
182024-07-06T00:09:08.245ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "52a81213-76b6-4fd9-ac3b-2592477f5aa0" "--data" "/data/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 52a81213-76b6-4fd9-ac3b-2592477f5aa0
192024-07-06T00:09:08.380ZINFOcrucible-agent (worker): region files created ok region = 52a81213-76b6-4fd9-ac3b-2592477f5aa0
202024-07-06T00:09:08.380ZINFOcrucible-agent (datafile): region 52a81213-76b6-4fd9-ac3b-2592477f5aa0 state: Requested -> Created
212024-07-06T00:09:08.380ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-07-06T00:09:08.381ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-52a81213-76b6-4fd9-ac3b-2592477f5aa0
232024-07-06T00:09:08.385ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-52a81213-76b6-4fd9-ac3b-2592477f5aa0
242024-07-06T00:09:08.396ZINFOcrucible-agent (worker): creating config property group
252024-07-06T00:09:08.399ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-52a81213-76b6-4fd9-ac3b-2592477f5aa0
262024-07-06T00:09:08.399ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0
272024-07-06T00:09:08.401ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-07-06T00:09:08.401ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
292024-07-06T00:09:08.401ZINFOcrucible-agent (worker): commit
302024-07-06T00:09:08.409ZINFOcrucible-agent (worker): ok!
312024-07-06T00:09:08.414ZINFOcrucible-agent (worker): SMF ok!
322024-07-06T00:09:08.414ZINFOcrucible-agent (dropshot): request completed latency_us = 798 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54427 req_id = a3a21ea9-2e9e-4c69-92cd-c81beadc498f response_code = 200 uri = /crucible/0/regions
332024-07-06T00:14:30.750ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:54740
342024-07-06T00:14:30.753ZINFOcrucible-agent (dropshot): request completed latency_us = 2749 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54740 req_id = 897a585b-398a-440c-892a-8753aea75774 response_code = 200 uri = /crucible/0/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0
352024-07-06T00:14:30.755ZINFOcrucible-agent (datafile): path is "/data/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0"
362024-07-06T00:14:30.764ZINFOcrucible-agent (datafile): dataset is oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0
372024-07-06T00:14:30.773ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0@3916d487-df2b-42eb-b478-d4b46764e516
382024-07-06T00:14:30.773ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0", "3916d487-df2b-42eb-b478-d4b46764e516"]
392024-07-06T00:14:30.784ZINFOcrucible-agent (dropshot): request completed latency_us = 31341 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54740 req_id = 65768d41-b7b4-4394-906f-95c8e91d1831 response_code = 200 uri = /crucible/0/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0/snapshots/3916d487-df2b-42eb-b478-d4b46764e516
402024-07-06T00:14:30.785ZINFOcrucible-agent (datafile): path is "/data/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0"
412024-07-06T00:14:30.793ZINFOcrucible-agent (datafile): dataset is oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0
422024-07-06T00:14:30.801ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0@3916d487-df2b-42eb-b478-d4b46764e516
432024-07-06T00:14:30.801ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1fb8d37a-fccb-4d16-a337-6873d3def608/crucible/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0", "3916d487-df2b-42eb-b478-d4b46764e516"]
442024-07-06T00:14:30.810ZINFOcrucible-agent (datafile): requesting running snapshot 52a81213-76b6-4fd9-ac3b-2592477f5aa0-3916d487-df2b-42eb-b478-d4b46764e516 state: Requested
452024-07-06T00:14:30.810ZINFOcrucible-agent (worker): applying SMF actions for region 52a81213-76b6-4fd9-ac3b-2592477f5aa0 running snapshot 3916d487-df2b-42eb-b478-d4b46764e516 (state Requested)...
462024-07-06T00:14:30.810ZINFOcrucible-agent (dropshot): request completed latency_us = 25951 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54740 req_id = f0d83fa8-4f75-4035-8c3b-72cd7cce3d63 response_code = 200 uri = /crucible/0/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0/snapshots/3916d487-df2b-42eb-b478-d4b46764e516/run
472024-07-06T00:14:30.821ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0
482024-07-06T00:14:30.821ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
492024-07-06T00:14:30.821ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::17
502024-07-06T00:14:30.821ZINFOcrucible-agent (worker): reconfig required
512024-07-06T00:14:30.821ZINFOcrucible-agent (worker): using existing config property group
522024-07-06T00:14:30.821ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-52a81213-76b6-4fd9-ac3b-2592477f5aa0
532024-07-06T00:14:30.821ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0
542024-07-06T00:14:30.821ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
552024-07-06T00:14:30.821ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
562024-07-06T00:14:30.821ZINFOcrucible-agent (worker): commit
572024-07-06T00:14:30.827ZINFOcrucible-agent (worker): ok!
582024-07-06T00:14:30.828ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-52a81213-76b6-4fd9-ac3b-2592477f5aa0-3916d487-df2b-42eb-b478-d4b46764e516
592024-07-06T00:14:30.830ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-52a81213-76b6-4fd9-ac3b-2592477f5aa0-3916d487-df2b-42eb-b478-d4b46764e516
602024-07-06T00:14:30.842ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-52a81213-76b6-4fd9-ac3b-2592477f5aa0-3916d487-df2b-42eb-b478-d4b46764e516
612024-07-06T00:14:30.842ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/52a81213-76b6-4fd9-ac3b-2592477f5aa0/.zfs/snapshot/3916d487-df2b-42eb-b478-d4b46764e516
622024-07-06T00:14:30.842ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
632024-07-06T00:14:30.842ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
642024-07-06T00:14:30.842ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
652024-07-06T00:14:30.842ZINFOcrucible-agent (worker): commit
662024-07-06T00:14:30.846ZINFOcrucible-agent (worker): ok!
672024-07-06T00:14:30.850ZINFOcrucible-agent (worker): SMF ok!
682024-07-06T00:14:30.850ZINFOcrucible-agent (datafile): region 52a81213-76b6-4fd9-ac3b-2592477f5aa0 running snapshot 3916d487-df2b-42eb-b478-d4b46764e516 state: Requested -> Created