Max level shown:
1 [ Oct 19 04:09:00 Enabled. ]
2 [ Oct 19 04:09:00 Rereading configuration. ]
3 [ Oct 19 04:09:01 Rereading configuration. ]
4 [ Oct 19 04:09:03 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_d4b5557b-f3db-4c39-a8ed-f7304d32ea11/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-19T04:09:03.708ZINFOcrucible-agent: dataset: "oxp_d4b5557b-f3db-4c39-a8ed-f7304d32ea11/crucible"
72024-10-19T04:09:03.711ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-10-19T04:09:03.711ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-19T04:09:03.756ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-19T04:09:03.909ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-10-19T04:10:09.245ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::b]:43836
122024-10-19T04:10:09.268ZINFOcrucible-agent (datafile): region bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6 state: Requested
132024-10-19T04:10:09.276ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-10-19T04:10:09.280ZINFOcrucible-agent (dropshot): request completed latency_us = 19097 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43836 req_id = dd7ec089-b2f8-462c-8514-fb0486436b0e response_code = 200 uri = /crucible/0/regions
152024-10-19T04:10:09.288ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_d4b5557b-f3db-4c39-a8ed-f7304d32ea11/crucible/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
162024-10-19T04:10:09.288ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_d4b5557b-f3db-4c39-a8ed-f7304d32ea11/crucible/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
172024-10-19T04:10:09.343ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6" region = bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
182024-10-19T04:10:09.345ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6" "--data" "/data/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
192024-10-19T04:10:09.463ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43836 req_id = 4ef9bb19-bafa-4371-a168-5a59f615139b response_code = 200 uri = /crucible/0/regions
202024-10-19T04:10:09.592ZINFOcrucible-agent (worker): region files created ok region = bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
212024-10-19T04:10:09.592ZINFOcrucible-agent (datafile): region bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6 state: Requested -> Created
222024-10-19T04:10:09.592ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-10-19T04:10:09.592ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
242024-10-19T04:10:09.595ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
252024-10-19T04:10:09.613ZINFOcrucible-agent (worker): creating config property group
262024-10-19T04:10:09.623ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
272024-10-19T04:10:09.626ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
282024-10-19T04:10:09.628ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-10-19T04:10:09.629ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
302024-10-19T04:10:09.629ZINFOcrucible-agent (worker): commit
312024-10-19T04:10:09.632ZINFOcrucible-agent (worker): ok!
322024-10-19T04:10:09.637ZINFOcrucible-agent (worker): SMF ok!
332024-10-19T04:10:09.874ZINFOcrucible-agent (dropshot): request completed latency_us = 955 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43836 req_id = 91b95a9c-01d7-4301-a8fb-2bd64ba3ef52 response_code = 200 uri = /crucible/0/regions
342024-10-19T04:10:10.135ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:43836 req_id = 70d02e75-1f89-449a-bfb1-5fff6716bcef response_code = 200 uri = /crucible/0/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
352024-10-19T04:10:10.137ZINFOcrucible-agent (datafile): path is "/data/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6"
362024-10-19T04:10:10.147ZINFOcrucible-agent (datafile): dataset is oxp_d4b5557b-f3db-4c39-a8ed-f7304d32ea11/crucible/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
372024-10-19T04:10:10.155ZINFOcrucible-agent (datafile): region bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6 state: Created -> Tombstoned
382024-10-19T04:10:10.156ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-10-19T04:10:10.156ZINFOcrucible-agent (dropshot): request completed latency_us = 19004 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:43836 req_id = 33a523a7-0a7c-4288-8aa0-6e445f0ece67 response_code = 204 uri = /crucible/0/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
402024-10-19T04:10:10.157ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6 (instance states: (Some(Online), None))
412024-10-19T04:10:10.158ZINFOcrucible-agent (dropshot): request completed latency_us = 628 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:43836 req_id = 7b5b9c33-5cee-43d3-868e-dcf991d2f504 response_code = 200 uri = /crucible/0/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
422024-10-19T04:10:10.161ZINFOcrucible-agent (worker): SMF ok!
432024-10-19T04:10:10.170ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d4b5557b-f3db-4c39-a8ed-f7304d32ea11/crucible/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6" region = bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6
442024-10-19T04:10:10.219ZINFOcrucible-agent (datafile): region bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6 state: Tombstoned -> Destroyed
452024-10-19T04:10:10.296ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:43836 req_id = 49f4bc60-f386-415e-a83e-26f9226a56b1 response_code = 200 uri = /crucible/0/regions/bb83dc6a-4aaf-4ad3-a5e8-5d84243b94b6