Max level shown:
1 [ Oct 9 04:56:25 Enabled. ]
2 [ Oct 9 04:56:25 Rereading configuration. ]
3 [ Oct 9 04:56:30 Rereading configuration. ]
4 [ Oct 9 04:56:35 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_6fa6258a-7497-4e15-a529-59061c358fa5/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-09T04:56:35.107ZINFOcrucible-agent: dataset: "oxp_6fa6258a-7497-4e15-a529-59061c358fa5/crucible"
72024-10-09T04:56:35.109ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-10-09T04:56:35.109ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-09T04:56:35.127ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-09T04:56:35.291ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-10-09T04:56:57.342ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:63293
122024-10-09T04:56:57.359ZINFOcrucible-agent (datafile): region 77ac7736-524a-4386-bca7-7cf4726b1d26 state: Requested
132024-10-09T04:56:57.363ZINFOcrucible-agent (dropshot): request completed latency_us = 6722 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63293 req_id = fb8f5161-833e-40fc-af13-7a4d39d0e566 response_code = 200 uri = /crucible/0/regions
142024-10-09T04:56:57.364ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-10-09T04:56:57.374ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_6fa6258a-7497-4e15-a529-59061c358fa5/crucible/regions/77ac7736-524a-4386-bca7-7cf4726b1d26
162024-10-09T04:56:57.374ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_6fa6258a-7497-4e15-a529-59061c358fa5/crucible/regions/77ac7736-524a-4386-bca7-7cf4726b1d26
172024-10-09T04:56:57.441ZINFOcrucible-agent (worker): creating region Region { id: RegionId("77ac7736-524a-4386-bca7-7cf4726b1d26"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/77ac7736-524a-4386-bca7-7cf4726b1d26" region = 77ac7736-524a-4386-bca7-7cf4726b1d26
182024-10-09T04:56:57.445ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "77ac7736-524a-4386-bca7-7cf4726b1d26" "--data" "/data/regions/77ac7736-524a-4386-bca7-7cf4726b1d26" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 77ac7736-524a-4386-bca7-7cf4726b1d26
192024-10-09T04:56:57.561ZINFOcrucible-agent (worker): region files created ok region = 77ac7736-524a-4386-bca7-7cf4726b1d26
202024-10-09T04:56:57.562ZINFOcrucible-agent (datafile): region 77ac7736-524a-4386-bca7-7cf4726b1d26 state: Requested -> Created
212024-10-09T04:56:57.562ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-10-09T04:56:57.562ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-77ac7736-524a-4386-bca7-7cf4726b1d26
232024-10-09T04:56:57.566ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-77ac7736-524a-4386-bca7-7cf4726b1d26
242024-10-09T04:56:57.578ZINFOcrucible-agent (worker): creating config property group
252024-10-09T04:56:57.583ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-77ac7736-524a-4386-bca7-7cf4726b1d26
262024-10-09T04:56:57.584ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/77ac7736-524a-4386-bca7-7cf4726b1d26
272024-10-09T04:56:57.584ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-10-09T04:56:57.584ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
292024-10-09T04:56:57.584ZINFOcrucible-agent (worker): commit
302024-10-09T04:56:57.590ZINFOcrucible-agent (worker): ok!
312024-10-09T04:56:57.597ZINFOcrucible-agent (worker): SMF ok!
322024-10-09T04:56:57.597ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63293 req_id = fccc030a-cf36-4a8e-88c1-e0603a8b43e3 response_code = 200 uri = /crucible/0/regions
332024-10-09T04:56:58.136ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63293 req_id = 8b5fe0f7-fc4c-4e29-861a-39b04368a9e7 response_code = 200 uri = /crucible/0/regions/77ac7736-524a-4386-bca7-7cf4726b1d26
342024-10-09T04:56:58.139ZINFOcrucible-agent (datafile): path is "/data/regions/77ac7736-524a-4386-bca7-7cf4726b1d26"
352024-10-09T04:56:58.151ZINFOcrucible-agent (datafile): dataset is oxp_6fa6258a-7497-4e15-a529-59061c358fa5/crucible/regions/77ac7736-524a-4386-bca7-7cf4726b1d26
362024-10-09T04:56:58.161ZINFOcrucible-agent (datafile): region 77ac7736-524a-4386-bca7-7cf4726b1d26 state: Created -> Tombstoned
372024-10-09T04:56:58.161ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-10-09T04:56:58.161ZINFOcrucible-agent (dropshot): request completed latency_us = 22717 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:63293 req_id = 20e4fb50-dc0c-4eba-a440-12870d59be3b response_code = 204 uri = /crucible/0/regions/77ac7736-524a-4386-bca7-7cf4726b1d26
392024-10-09T04:56:58.162ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-77ac7736-524a-4386-bca7-7cf4726b1d26 (instance states: (Some(Online), None))
402024-10-09T04:56:58.165ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63293 req_id = c03a39b7-0c9a-4f04-9d91-bb843de91c10 response_code = 200 uri = /crucible/0/regions/77ac7736-524a-4386-bca7-7cf4726b1d26
412024-10-09T04:56:58.168ZINFOcrucible-agent (worker): SMF ok!
422024-10-09T04:56:58.179ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_6fa6258a-7497-4e15-a529-59061c358fa5/crucible/regions/77ac7736-524a-4386-bca7-7cf4726b1d26" region = 77ac7736-524a-4386-bca7-7cf4726b1d26
432024-10-09T04:56:58.255ZINFOcrucible-agent (datafile): region 77ac7736-524a-4386-bca7-7cf4726b1d26 state: Tombstoned -> Destroyed
442024-10-09T04:56:58.268ZINFOcrucible-agent (dropshot): request completed latency_us = 720 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63293 req_id = e151f03e-7911-4d68-bcae-3a4f4670ec7e response_code = 200 uri = /crucible/0/regions/77ac7736-524a-4386-bca7-7cf4726b1d26
452024-10-09T04:57:00.129ZINFOcrucible-agent (datafile): region 260c9d1e-2b9e-4249-b643-d29cd2205b54 state: Requested
462024-10-09T04:57:00.129ZINFOcrucible-agent (dropshot): request completed latency_us = 259 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63293 req_id = 9a43cac9-4579-45b8-8c55-56664dc0c57c response_code = 200 uri = /crucible/0/regions
472024-10-09T04:57:00.129ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-10-09T04:57:00.139ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6fa6258a-7497-4e15-a529-59061c358fa5/crucible/regions/260c9d1e-2b9e-4249-b643-d29cd2205b54
492024-10-09T04:57:00.139ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6fa6258a-7497-4e15-a529-59061c358fa5/crucible/regions/260c9d1e-2b9e-4249-b643-d29cd2205b54
502024-10-09T04:57:00.204ZINFOcrucible-agent (worker): creating region Region { id: RegionId("260c9d1e-2b9e-4249-b643-d29cd2205b54"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/260c9d1e-2b9e-4249-b643-d29cd2205b54" region = 260c9d1e-2b9e-4249-b643-d29cd2205b54
512024-10-09T04:57:00.205ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "260c9d1e-2b9e-4249-b643-d29cd2205b54" "--data" "/data/regions/260c9d1e-2b9e-4249-b643-d29cd2205b54" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 260c9d1e-2b9e-4249-b643-d29cd2205b54
522024-10-09T04:57:00.279ZINFOcrucible-agent (worker): region files created ok region = 260c9d1e-2b9e-4249-b643-d29cd2205b54
532024-10-09T04:57:00.279ZINFOcrucible-agent (datafile): region 260c9d1e-2b9e-4249-b643-d29cd2205b54 state: Requested -> Created
542024-10-09T04:57:00.279ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-10-09T04:57:00.281ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-260c9d1e-2b9e-4249-b643-d29cd2205b54
562024-10-09T04:57:00.284ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-260c9d1e-2b9e-4249-b643-d29cd2205b54
572024-10-09T04:57:00.314ZINFOcrucible-agent (worker): creating config property group
582024-10-09T04:57:00.319ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63293 req_id = 0b99ac6d-08a3-46b9-8591-e6e4747ff8f7 response_code = 200 uri = /crucible/0/regions
592024-10-09T04:57:00.332ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-260c9d1e-2b9e-4249-b643-d29cd2205b54
602024-10-09T04:57:00.332ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/260c9d1e-2b9e-4249-b643-d29cd2205b54
612024-10-09T04:57:00.332ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-10-09T04:57:00.332ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
632024-10-09T04:57:00.332ZINFOcrucible-agent (worker): commit
642024-10-09T04:57:00.338ZINFOcrucible-agent (worker): ok!
652024-10-09T04:57:00.344ZINFOcrucible-agent (worker): SMF ok!