Max level shown:
1 [ Jul 9 03:56:27 Enabled. ]
2 [ Jul 9 03:56:27 Rereading configuration. ]
3 [ Jul 9 03:56:28 Rereading configuration. ]
4 [ Jul 9 03:56:31 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_6465aeea-d024-4ee4-a24b-ff08e90708a1/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-09T03:56:31.188ZINFOcrucible-agent: dataset: "oxp_6465aeea-d024-4ee4-a24b-ff08e90708a1/crucible"
72024-07-09T03:56:31.198ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82024-07-09T03:56:31.198ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-09T03:56:31.282ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-09T03:56:31.468ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
112024-07-09T03:57:10.683ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:46140
122024-07-09T03:57:10.684ZINFOcrucible-agent (datafile): region 6c174b78-12e7-4366-8d6e-be7cd0a97601 state: Requested
132024-07-09T03:57:10.686ZINFOcrucible-agent (dropshot): request completed latency_us = 2641 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46140 req_id = aebd92c3-2ef1-493a-b1fb-03c1c7e6619c response_code = 200 uri = /crucible/0/regions
142024-07-09T03:57:10.687ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-07-09T03:57:10.697ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_6465aeea-d024-4ee4-a24b-ff08e90708a1/crucible/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601
162024-07-09T03:57:10.697ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_6465aeea-d024-4ee4-a24b-ff08e90708a1/crucible/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601
172024-07-09T03:57:10.756ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6c174b78-12e7-4366-8d6e-be7cd0a97601"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601" region = 6c174b78-12e7-4366-8d6e-be7cd0a97601
182024-07-09T03:57:10.756ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6c174b78-12e7-4366-8d6e-be7cd0a97601" "--data" "/data/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 6c174b78-12e7-4366-8d6e-be7cd0a97601
192024-07-09T03:57:10.864ZINFOcrucible-agent (worker): region files created ok region = 6c174b78-12e7-4366-8d6e-be7cd0a97601
202024-07-09T03:57:10.864ZINFOcrucible-agent (datafile): region 6c174b78-12e7-4366-8d6e-be7cd0a97601 state: Requested -> Created
212024-07-09T03:57:10.864ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-07-09T03:57:10.865ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6c174b78-12e7-4366-8d6e-be7cd0a97601
232024-07-09T03:57:10.868ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6c174b78-12e7-4366-8d6e-be7cd0a97601
242024-07-09T03:57:10.876ZINFOcrucible-agent (worker): creating config property group
252024-07-09T03:57:10.876ZINFOcrucible-agent (dropshot): request completed latency_us = 652 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46140 req_id = 32625cd4-0bae-4091-a1e7-dd7fa15e26f5 response_code = 200 uri = /crucible/0/regions
262024-07-09T03:57:10.879ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6c174b78-12e7-4366-8d6e-be7cd0a97601
272024-07-09T03:57:10.880ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601
282024-07-09T03:57:10.882ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-09T03:57:10.882ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
302024-07-09T03:57:10.882ZINFOcrucible-agent (worker): commit
312024-07-09T03:57:10.891ZINFOcrucible-agent (worker): ok!
322024-07-09T03:57:10.897ZINFOcrucible-agent (worker): SMF ok!
332024-07-09T03:57:11.576ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46140 req_id = cd8d4db6-dd02-442c-b3ef-a8dfc75775be response_code = 200 uri = /crucible/0/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601
342024-07-09T03:57:11.579ZINFOcrucible-agent (datafile): path is "/data/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601"
352024-07-09T03:57:11.588ZINFOcrucible-agent (datafile): dataset is oxp_6465aeea-d024-4ee4-a24b-ff08e90708a1/crucible/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601
362024-07-09T03:57:11.596ZINFOcrucible-agent (datafile): region 6c174b78-12e7-4366-8d6e-be7cd0a97601 state: Created -> Tombstoned
372024-07-09T03:57:11.596ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-07-09T03:57:11.597ZINFOcrucible-agent (dropshot): request completed latency_us = 18048 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:46140 req_id = a9ee601c-b8df-4de1-8f4b-132f7f1a126f response_code = 204 uri = /crucible/0/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601
392024-07-09T03:57:11.598ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6c174b78-12e7-4366-8d6e-be7cd0a97601 (instance states: (Some(Online), None))
402024-07-09T03:57:11.600ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46140 req_id = ff7e045b-4823-4dad-aaee-b18e4612a28d response_code = 200 uri = /crucible/0/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601
412024-07-09T03:57:11.602ZINFOcrucible-agent (worker): SMF ok!
422024-07-09T03:57:11.611ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_6465aeea-d024-4ee4-a24b-ff08e90708a1/crucible/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601" region = 6c174b78-12e7-4366-8d6e-be7cd0a97601
432024-07-09T03:57:11.661ZINFOcrucible-agent (datafile): region 6c174b78-12e7-4366-8d6e-be7cd0a97601 state: Tombstoned -> Destroyed
442024-07-09T03:57:11.728ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46140 req_id = 0c4ee0a3-cc6d-4ccf-8591-1613c7498ba0 response_code = 200 uri = /crucible/0/regions/6c174b78-12e7-4366-8d6e-be7cd0a97601
452024-07-09T03:57:13.490ZINFOcrucible-agent (datafile): region 1701aba8-1c09-4b05-8dda-08579865b105 state: Requested
462024-07-09T03:57:13.492ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
472024-07-09T03:57:13.492ZINFOcrucible-agent (dropshot): request completed latency_us = 2936 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46140 req_id = 56971a1d-e86e-475e-9f63-6df883c2e024 response_code = 200 uri = /crucible/0/regions
482024-07-09T03:57:13.501ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6465aeea-d024-4ee4-a24b-ff08e90708a1/crucible/regions/1701aba8-1c09-4b05-8dda-08579865b105
492024-07-09T03:57:13.501ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6465aeea-d024-4ee4-a24b-ff08e90708a1/crucible/regions/1701aba8-1c09-4b05-8dda-08579865b105
502024-07-09T03:57:13.572ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1701aba8-1c09-4b05-8dda-08579865b105"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1701aba8-1c09-4b05-8dda-08579865b105" region = 1701aba8-1c09-4b05-8dda-08579865b105
512024-07-09T03:57:13.575ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1701aba8-1c09-4b05-8dda-08579865b105" "--data" "/data/regions/1701aba8-1c09-4b05-8dda-08579865b105" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1701aba8-1c09-4b05-8dda-08579865b105
522024-07-09T03:57:13.643ZINFOcrucible-agent (worker): region files created ok region = 1701aba8-1c09-4b05-8dda-08579865b105
532024-07-09T03:57:13.643ZINFOcrucible-agent (datafile): region 1701aba8-1c09-4b05-8dda-08579865b105 state: Requested -> Created
542024-07-09T03:57:13.643ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-07-09T03:57:13.644ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1701aba8-1c09-4b05-8dda-08579865b105
562024-07-09T03:57:13.647ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1701aba8-1c09-4b05-8dda-08579865b105
572024-07-09T03:57:13.656ZINFOcrucible-agent (worker): creating config property group
582024-07-09T03:57:13.659ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1701aba8-1c09-4b05-8dda-08579865b105
592024-07-09T03:57:13.659ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1701aba8-1c09-4b05-8dda-08579865b105
602024-07-09T03:57:13.659ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-07-09T03:57:13.659ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
622024-07-09T03:57:13.659ZINFOcrucible-agent (worker): commit
632024-07-09T03:57:13.663ZINFOcrucible-agent (worker): ok!
642024-07-09T03:57:13.669ZINFOcrucible-agent (worker): SMF ok!
652024-07-09T03:57:13.749ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46140 req_id = 8e37eb56-7ebe-4d28-8545-9f4cd3937ecd response_code = 200 uri = /crucible/0/regions