Max level shown:
1 [ Mar 21 18:03:38 Enabled. ]
2 [ Mar 21 18:03:38 Rereading configuration. ]
3 [ Mar 21 18:03:40 Rereading configuration. ]
4 [ Mar 21 18:03:42 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-21T18:03:42.662ZINFOcrucible-agent: dataset: "oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible"
72024-03-21T18:03:42.665ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-03-21T18:03:42.665ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-21T18:03:42.852ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
102024-03-21T18:04:12.049ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:62433
112024-03-21T18:04:12.117ZINFOcrucible-agent (datafile): region 6db8394b-7024-4c25-a268-739effb93108 state: Requested
122024-03-21T18:04:12.117ZINFOcrucible-agent (dropshot): request completed latency_us = 6044 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62433 req_id = 31a4e063-2c30-4675-aa14-145e0cd86420 response_code = 200 uri = /crucible/0/regions
132024-03-21T18:04:12.117ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-03-21T18:04:12.127ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/6db8394b-7024-4c25-a268-739effb93108
152024-03-21T18:04:12.128ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/6db8394b-7024-4c25-a268-739effb93108
162024-03-21T18:04:12.206ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6db8394b-7024-4c25-a268-739effb93108"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/6db8394b-7024-4c25-a268-739effb93108" region = 6db8394b-7024-4c25-a268-739effb93108
172024-03-21T18:04:12.326ZINFOcrucible-agent (worker): region files created ok region = 6db8394b-7024-4c25-a268-739effb93108
182024-03-21T18:04:12.326ZINFOcrucible-agent (datafile): region 6db8394b-7024-4c25-a268-739effb93108 state: Requested -> Created
192024-03-21T18:04:12.326ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-03-21T18:04:12.327ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6db8394b-7024-4c25-a268-739effb93108
212024-03-21T18:04:12.330ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6db8394b-7024-4c25-a268-739effb93108
222024-03-21T18:04:12.343ZINFOcrucible-agent (worker): creating config property group
232024-03-21T18:04:12.347ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6db8394b-7024-4c25-a268-739effb93108
242024-03-21T18:04:12.348ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6db8394b-7024-4c25-a268-739effb93108
252024-03-21T18:04:12.350ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-03-21T18:04:12.350ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
272024-03-21T18:04:12.350ZINFOcrucible-agent (worker): commit
282024-03-21T18:04:12.360ZINFOcrucible-agent (worker): ok!
292024-03-21T18:04:12.363ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62433 req_id = 65c1ac18-ee2c-48f7-ab82-d72e9381e9f3 response_code = 200 uri = /crucible/0/regions
302024-03-21T18:04:12.366ZINFOcrucible-agent (worker): SMF ok!
312024-03-21T18:04:12.706ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:39303
322024-03-21T18:04:12.706ZINFOcrucible-agent (dropshot): request completed latency_us = 97 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39303 req_id = 918831f8-7f78-4095-aa9d-af853bfc18d9 response_code = 200 uri = /crucible/0/regions/6db8394b-7024-4c25-a268-739effb93108
332024-03-21T18:04:12.706ZINFOcrucible-agent (datafile): path is "/data/regions/6db8394b-7024-4c25-a268-739effb93108"
342024-03-21T18:04:12.715ZINFOcrucible-agent (datafile): dataset is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/6db8394b-7024-4c25-a268-739effb93108
352024-03-21T18:04:12.723ZINFOcrucible-agent (datafile): region 6db8394b-7024-4c25-a268-739effb93108 state: Created -> Tombstoned
362024-03-21T18:04:12.724ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-03-21T18:04:12.724ZINFOcrucible-agent (dropshot): request completed latency_us = 17667 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:39303 req_id = 5a809a0a-9cac-4bc8-9d03-35a98a2fd95d response_code = 204 uri = /crucible/0/regions/6db8394b-7024-4c25-a268-739effb93108
382024-03-21T18:04:12.724ZINFOcrucible-agent (dropshot): request completed latency_us = 21 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39303 req_id = 9d7bc37f-02d9-41dd-b789-e410e03102e6 response_code = 200 uri = /crucible/0/regions/6db8394b-7024-4c25-a268-739effb93108
392024-03-21T18:04:12.725ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6db8394b-7024-4c25-a268-739effb93108 (instance states: (Some(Online), None))
402024-03-21T18:04:12.729ZINFOcrucible-agent (worker): SMF ok!
412024-03-21T18:04:12.740ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/6db8394b-7024-4c25-a268-739effb93108" region = 6db8394b-7024-4c25-a268-739effb93108
422024-03-21T18:04:12.781ZINFOcrucible-agent (dropshot): request completed latency_us = 93 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39303 req_id = f764a0d9-58ac-418a-8768-be4c21dea39a response_code = 200 uri = /crucible/0/regions/6db8394b-7024-4c25-a268-739effb93108
432024-03-21T18:04:12.798ZINFOcrucible-agent (datafile): region 6db8394b-7024-4c25-a268-739effb93108 state: Tombstoned -> Destroyed
442024-03-21T18:04:12.848ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39303 req_id = 821680ce-6689-43b9-8e2c-8f38a089d1c3 response_code = 200 uri = /crucible/0/regions/6db8394b-7024-4c25-a268-739effb93108
452024-03-21T18:10:01.884ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:60466
462024-03-21T18:10:01.884ZINFOcrucible-agent (datafile): region 7d351e63-33a7-41d4-95b9-796c77966798 state: Requested
472024-03-21T18:10:01.884ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-03-21T18:10:01.884ZINFOcrucible-agent (dropshot): request completed latency_us = 888 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60466 req_id = 8e7e3beb-158b-4468-a2dd-61872fd940ad response_code = 200 uri = /crucible/0/regions
492024-03-21T18:10:01.897ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/7d351e63-33a7-41d4-95b9-796c77966798
502024-03-21T18:10:01.897ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/7d351e63-33a7-41d4-95b9-796c77966798
512024-03-21T18:10:01.952ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7d351e63-33a7-41d4-95b9-796c77966798"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/7d351e63-33a7-41d4-95b9-796c77966798" region = 7d351e63-33a7-41d4-95b9-796c77966798
522024-03-21T18:10:02.020ZINFOcrucible-agent (worker): region files created ok region = 7d351e63-33a7-41d4-95b9-796c77966798
532024-03-21T18:10:02.020ZINFOcrucible-agent (datafile): region 7d351e63-33a7-41d4-95b9-796c77966798 state: Requested -> Created
542024-03-21T18:10:02.020ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-03-21T18:10:02.021ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7d351e63-33a7-41d4-95b9-796c77966798
562024-03-21T18:10:02.026ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7d351e63-33a7-41d4-95b9-796c77966798
572024-03-21T18:10:02.040ZINFOcrucible-agent (worker): creating config property group
582024-03-21T18:10:02.043ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7d351e63-33a7-41d4-95b9-796c77966798
592024-03-21T18:10:02.043ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7d351e63-33a7-41d4-95b9-796c77966798
602024-03-21T18:10:02.043ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-03-21T18:10:02.043ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
622024-03-21T18:10:02.043ZINFOcrucible-agent (worker): commit
632024-03-21T18:10:02.047ZINFOcrucible-agent (worker): ok!
642024-03-21T18:10:02.051ZINFOcrucible-agent (worker): SMF ok!
652024-03-21T18:10:02.140ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60466 req_id = f1b29d2a-1fa7-40b2-99f1-f96d4e457f5b response_code = 200 uri = /crucible/0/regions