Max level shown:
1 [ Jul 15 19:54:09 Enabled. ]
2 [ Jul 15 19:54:09 Rereading configuration. ]
3 [ Jul 15 19:54:10 Rereading configuration. ]
4 [ Jul 15 19:54:12 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_18103694-d170-41d5-bbb6-011cf270acdf/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-15T19:54:12.552ZINFOcrucible-agent: dataset: "oxp_18103694-d170-41d5-bbb6-011cf270acdf/crucible"
72024-07-15T19:54:12.554ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
82024-07-15T19:54:12.554ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-15T19:54:12.573ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-15T19:54:12.662ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
112024-07-15T19:54:41.878ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:61699
122024-07-15T19:54:41.894ZINFOcrucible-agent (datafile): region c2576f0e-055f-481b-aa2b-d165afaa6f8d state: Requested
132024-07-15T19:54:41.908ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-07-15T19:54:41.908ZINFOcrucible-agent (dropshot): request completed latency_us = 18973 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61699 req_id = 60917f47-fdeb-466c-bfb5-d2d08f55608c response_code = 200 uri = /crucible/0/regions
152024-07-15T19:54:41.921ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_18103694-d170-41d5-bbb6-011cf270acdf/crucible/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
162024-07-15T19:54:41.921ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_18103694-d170-41d5-bbb6-011cf270acdf/crucible/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
172024-07-15T19:54:42.171ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c2576f0e-055f-481b-aa2b-d165afaa6f8d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d" region = c2576f0e-055f-481b-aa2b-d165afaa6f8d
182024-07-15T19:54:42.173ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61699 req_id = c620cd73-084f-4275-a8c6-03be6aae42b9 response_code = 200 uri = /crucible/0/regions
192024-07-15T19:54:42.174ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c2576f0e-055f-481b-aa2b-d165afaa6f8d" "--data" "/data/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = c2576f0e-055f-481b-aa2b-d165afaa6f8d
202024-07-15T19:54:42.509ZINFOcrucible-agent (dropshot): request completed latency_us = 738 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61699 req_id = ea2a19e7-4494-4ccc-af62-bb16e765c038 response_code = 200 uri = /crucible/0/regions
212024-07-15T19:54:42.573ZINFOcrucible-agent (worker): region files created ok region = c2576f0e-055f-481b-aa2b-d165afaa6f8d
222024-07-15T19:54:42.573ZINFOcrucible-agent (datafile): region c2576f0e-055f-481b-aa2b-d165afaa6f8d state: Requested -> Created
232024-07-15T19:54:42.573ZINFOcrucible-agent (worker): applying SMF actions post create...
242024-07-15T19:54:42.574ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c2576f0e-055f-481b-aa2b-d165afaa6f8d
252024-07-15T19:54:42.592ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c2576f0e-055f-481b-aa2b-d165afaa6f8d
262024-07-15T19:54:42.698ZINFOcrucible-agent (worker): creating config property group
272024-07-15T19:54:42.748ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c2576f0e-055f-481b-aa2b-d165afaa6f8d
282024-07-15T19:54:42.749ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
292024-07-15T19:54:42.753ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302024-07-15T19:54:42.753ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
312024-07-15T19:54:42.753ZINFOcrucible-agent (worker): commit
322024-07-15T19:54:42.850ZINFOcrucible-agent (worker): ok!
332024-07-15T19:54:42.921ZINFOcrucible-agent (worker): SMF ok!
342024-07-15T19:54:43.838ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61699 req_id = 506083fe-a3cc-434d-8ee5-b4f0fa6c3310 response_code = 200 uri = /crucible/0/regions
352024-07-15T19:54:46.474ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61699 req_id = 690f3e4d-9955-48c2-8563-a2189cdb6bee response_code = 200 uri = /crucible/0/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
362024-07-15T19:54:46.478ZINFOcrucible-agent (datafile): path is "/data/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d"
372024-07-15T19:54:46.487ZINFOcrucible-agent (datafile): dataset is oxp_18103694-d170-41d5-bbb6-011cf270acdf/crucible/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
382024-07-15T19:54:46.495ZINFOcrucible-agent (datafile): region c2576f0e-055f-481b-aa2b-d165afaa6f8d state: Created -> Tombstoned
392024-07-15T19:54:46.495ZINFOcrucible-agent (worker): applying SMF actions before removal...
402024-07-15T19:54:46.495ZINFOcrucible-agent (dropshot): request completed latency_us = 17733 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:61699 req_id = 58cc1cbe-f3fd-4776-af40-b4cdee0f25fb response_code = 204 uri = /crucible/0/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
412024-07-15T19:54:46.496ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c2576f0e-055f-481b-aa2b-d165afaa6f8d (instance states: (Some(Online), None))
422024-07-15T19:54:46.498ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61699 req_id = 821c3394-50a0-4564-836f-bdb8d9d12dd0 response_code = 200 uri = /crucible/0/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
432024-07-15T19:54:46.573ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61699 req_id = f7c03b2b-14b1-4f2a-b808-a03a2db5cf98 response_code = 200 uri = /crucible/0/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
442024-07-15T19:54:46.607ZINFOcrucible-agent (worker): SMF ok!
452024-07-15T19:54:46.616ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_18103694-d170-41d5-bbb6-011cf270acdf/crucible/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d" region = c2576f0e-055f-481b-aa2b-d165afaa6f8d
462024-07-15T19:54:46.649ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61699 req_id = 4e5de9fe-14b2-443e-a116-73b2234f2ee4 response_code = 200 uri = /crucible/0/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
472024-07-15T19:54:46.745ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61699 req_id = efc3df13-7ca2-4945-bb4e-1e275f6d81c8 response_code = 200 uri = /crucible/0/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d
482024-07-15T19:54:46.775ZINFOcrucible-agent (datafile): region c2576f0e-055f-481b-aa2b-d165afaa6f8d state: Tombstoned -> Destroyed
492024-07-15T19:54:47.002ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61699 req_id = c5f9b0ba-a7eb-422c-8aa5-72522afe608b response_code = 200 uri = /crucible/0/regions/c2576f0e-055f-481b-aa2b-d165afaa6f8d