Max level shown:
1 [ Dec 20 21:12:00 Enabled. ]
2 [ Dec 20 21:12:00 Rereading configuration. ]
3 [ Dec 20 21:12:12 Rereading configuration. ]
4 [ Dec 20 21:12:18 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-20T21:12:18.407ZINFOcrucible-agent: dataset: "oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible"
72024-12-20T21:12:18.410ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-12-20T21:12:18.410ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-20T21:12:18.424ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-20T21:12:18.541ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-12-20T21:13:06.152ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:35096
122024-12-20T21:13:06.169ZINFOcrucible-agent (datafile): region 1bcd2179-d421-47ab-91d2-401494d03561 state: Requested
132024-12-20T21:13:06.173ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-12-20T21:13:06.173ZINFOcrucible-agent (dropshot): request completed latency_us = 6923 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35096 req_id = 3e598c1f-074b-48a3-a5b8-bba65411e08e response_code = 200 uri = /crucible/0/regions
152024-12-20T21:13:06.183ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible/regions/1bcd2179-d421-47ab-91d2-401494d03561
162024-12-20T21:13:06.183ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible/regions/1bcd2179-d421-47ab-91d2-401494d03561
172024-12-20T21:13:06.232ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1bcd2179-d421-47ab-91d2-401494d03561"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1bcd2179-d421-47ab-91d2-401494d03561" region = 1bcd2179-d421-47ab-91d2-401494d03561
182024-12-20T21:13:06.232ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1bcd2179-d421-47ab-91d2-401494d03561" "--data" "/data/regions/1bcd2179-d421-47ab-91d2-401494d03561" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 1bcd2179-d421-47ab-91d2-401494d03561
192024-12-20T21:13:06.367ZINFOcrucible-agent (worker): region files created ok region = 1bcd2179-d421-47ab-91d2-401494d03561
202024-12-20T21:13:06.367ZINFOcrucible-agent (datafile): region 1bcd2179-d421-47ab-91d2-401494d03561 state: Requested -> Created
212024-12-20T21:13:06.367ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-12-20T21:13:06.368ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1bcd2179-d421-47ab-91d2-401494d03561
232024-12-20T21:13:06.373ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1bcd2179-d421-47ab-91d2-401494d03561
242024-12-20T21:13:06.387ZINFOcrucible-agent (worker): creating config property group
252024-12-20T21:13:06.391ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1bcd2179-d421-47ab-91d2-401494d03561
262024-12-20T21:13:06.392ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1bcd2179-d421-47ab-91d2-401494d03561
272024-12-20T21:13:06.392ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-12-20T21:13:06.392ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
292024-12-20T21:13:06.392ZINFOcrucible-agent (worker): commit
302024-12-20T21:13:06.396ZINFOcrucible-agent (worker): ok!
312024-12-20T21:13:06.401ZINFOcrucible-agent (worker): SMF ok!
322024-12-20T21:13:06.437ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35096 req_id = 5365309b-4f59-4d5a-ac46-e52bff8aca73 response_code = 200 uri = /crucible/0/regions
332024-12-20T21:13:07.166ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35096 req_id = aa7f5979-e04c-40e9-93ff-15388bba905b response_code = 200 uri = /crucible/0/regions/1bcd2179-d421-47ab-91d2-401494d03561
342024-12-20T21:13:07.170ZINFOcrucible-agent (datafile): path is "/data/regions/1bcd2179-d421-47ab-91d2-401494d03561"
352024-12-20T21:13:07.181ZINFOcrucible-agent (datafile): dataset is oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible/regions/1bcd2179-d421-47ab-91d2-401494d03561
362024-12-20T21:13:07.190ZINFOcrucible-agent (datafile): region 1bcd2179-d421-47ab-91d2-401494d03561 state: Created -> Tombstoned
372024-12-20T21:13:07.190ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-12-20T21:13:07.190ZINFOcrucible-agent (dropshot): request completed latency_us = 20159 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:35096 req_id = 99886ad8-e5b7-42b0-b4d8-49e0ca73d69d response_code = 204 uri = /crucible/0/regions/1bcd2179-d421-47ab-91d2-401494d03561
392024-12-20T21:13:07.192ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-1bcd2179-d421-47ab-91d2-401494d03561 (instance states: (Some(Online), None))
402024-12-20T21:13:07.193ZINFOcrucible-agent (dropshot): request completed latency_us = 37 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35096 req_id = 740079ee-d327-462b-9dbc-e38cd23a72df response_code = 200 uri = /crucible/0/regions/1bcd2179-d421-47ab-91d2-401494d03561
412024-12-20T21:13:07.197ZINFOcrucible-agent (worker): SMF ok!
422024-12-20T21:13:07.207ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible/regions/1bcd2179-d421-47ab-91d2-401494d03561" region = 1bcd2179-d421-47ab-91d2-401494d03561
432024-12-20T21:13:07.267ZINFOcrucible-agent (datafile): region 1bcd2179-d421-47ab-91d2-401494d03561 state: Tombstoned -> Destroyed
442024-12-20T21:13:07.278ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35096 req_id = 1f8d236d-cfc6-4b7d-855d-42e2352b5377 response_code = 200 uri = /crucible/0/regions/1bcd2179-d421-47ab-91d2-401494d03561
452024-12-20T21:13:09.093ZINFOcrucible-agent (datafile): region 9f7878a7-25f2-4f5b-8669-d864f7153a96 state: Requested
462024-12-20T21:13:09.093ZINFOcrucible-agent (dropshot): request completed latency_us = 225 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35096 req_id = 7851df59-5efa-4215-aebf-88a2b44dab18 response_code = 200 uri = /crucible/0/regions
472024-12-20T21:13:09.093ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-12-20T21:13:09.102ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible/regions/9f7878a7-25f2-4f5b-8669-d864f7153a96
492024-12-20T21:13:09.102ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3aaf6321-1f78-413a-aeef-fc748a8d6f94/crucible/regions/9f7878a7-25f2-4f5b-8669-d864f7153a96
502024-12-20T21:13:09.152ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9f7878a7-25f2-4f5b-8669-d864f7153a96"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9f7878a7-25f2-4f5b-8669-d864f7153a96" region = 9f7878a7-25f2-4f5b-8669-d864f7153a96
512024-12-20T21:13:09.154ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9f7878a7-25f2-4f5b-8669-d864f7153a96" "--data" "/data/regions/9f7878a7-25f2-4f5b-8669-d864f7153a96" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9f7878a7-25f2-4f5b-8669-d864f7153a96
522024-12-20T21:13:09.222ZINFOcrucible-agent (worker): region files created ok region = 9f7878a7-25f2-4f5b-8669-d864f7153a96
532024-12-20T21:13:09.222ZINFOcrucible-agent (datafile): region 9f7878a7-25f2-4f5b-8669-d864f7153a96 state: Requested -> Created
542024-12-20T21:13:09.222ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-12-20T21:13:09.224ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9f7878a7-25f2-4f5b-8669-d864f7153a96
562024-12-20T21:13:09.227ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9f7878a7-25f2-4f5b-8669-d864f7153a96
572024-12-20T21:13:09.235ZINFOcrucible-agent (worker): creating config property group
582024-12-20T21:13:09.239ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9f7878a7-25f2-4f5b-8669-d864f7153a96
592024-12-20T21:13:09.239ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9f7878a7-25f2-4f5b-8669-d864f7153a96
602024-12-20T21:13:09.239ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-12-20T21:13:09.239ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
622024-12-20T21:13:09.239ZINFOcrucible-agent (worker): commit
632024-12-20T21:13:09.243ZINFOcrucible-agent (worker): ok!
642024-12-20T21:13:09.248ZINFOcrucible-agent (worker): SMF ok!
652024-12-20T21:13:09.449ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35096 req_id = c24d9709-a273-4e7c-bda5-4ad04d769339 response_code = 200 uri = /crucible/0/regions