Max level shown:
1 [ Sep 23 23:12:12 Enabled. ]
2 [ Sep 23 23:12:13 Rereading configuration. ]
3 [ Sep 23 23:12:14 Rereading configuration. ]
4 [ Sep 23 23:12:15 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-09-23T23:12:15.786ZINFOcrucible-agent: dataset: "oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible"
72024-09-23T23:12:15.786ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-09-23T23:12:15.786ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-09-23T23:12:15.809ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-09-23T23:12:15.940ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112024-09-23T23:12:44.383ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:61942
122024-09-23T23:12:44.410ZINFOcrucible-agent (datafile): region e617757d-65ed-411c-aaab-4220c112c3d8 state: Requested
132024-09-23T23:12:44.414ZINFOcrucible-agent (dropshot): request completed latency_us = 17807 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61942 req_id = a2ffdd09-bc03-48e2-9672-7f61d10250f4 response_code = 200 uri = /crucible/0/regions
142024-09-23T23:12:44.414ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-09-23T23:12:44.425ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible/regions/e617757d-65ed-411c-aaab-4220c112c3d8
162024-09-23T23:12:44.425ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible/regions/e617757d-65ed-411c-aaab-4220c112c3d8
172024-09-23T23:12:44.478ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e617757d-65ed-411c-aaab-4220c112c3d8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e617757d-65ed-411c-aaab-4220c112c3d8" region = e617757d-65ed-411c-aaab-4220c112c3d8
182024-09-23T23:12:44.482ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e617757d-65ed-411c-aaab-4220c112c3d8" "--data" "/data/regions/e617757d-65ed-411c-aaab-4220c112c3d8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = e617757d-65ed-411c-aaab-4220c112c3d8
192024-09-23T23:12:44.588ZINFOcrucible-agent (worker): region files created ok region = e617757d-65ed-411c-aaab-4220c112c3d8
202024-09-23T23:12:44.588ZINFOcrucible-agent (datafile): region e617757d-65ed-411c-aaab-4220c112c3d8 state: Requested -> Created
212024-09-23T23:12:44.589ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-09-23T23:12:44.591ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e617757d-65ed-411c-aaab-4220c112c3d8
232024-09-23T23:12:44.595ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e617757d-65ed-411c-aaab-4220c112c3d8
242024-09-23T23:12:44.606ZINFOcrucible-agent (worker): creating config property group
252024-09-23T23:12:44.610ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e617757d-65ed-411c-aaab-4220c112c3d8
262024-09-23T23:12:44.618ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e617757d-65ed-411c-aaab-4220c112c3d8
272024-09-23T23:12:44.620ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-09-23T23:12:44.620ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
292024-09-23T23:12:44.620ZINFOcrucible-agent (worker): commit
302024-09-23T23:12:44.625ZINFOcrucible-agent (worker): ok!
312024-09-23T23:12:44.632ZINFOcrucible-agent (worker): SMF ok!
322024-09-23T23:12:44.740ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61942 req_id = d626a8bf-0ed9-4b0f-b6f0-afd2af3aab85 response_code = 200 uri = /crucible/0/regions
332024-09-23T23:12:45.475ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61942 req_id = 9c4c52cc-54d7-49d7-b4ba-298de1147537 response_code = 200 uri = /crucible/0/regions/e617757d-65ed-411c-aaab-4220c112c3d8
342024-09-23T23:12:45.586ZINFOcrucible-agent (datafile): path is "/data/regions/e617757d-65ed-411c-aaab-4220c112c3d8"
352024-09-23T23:12:45.596ZINFOcrucible-agent (datafile): dataset is oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible/regions/e617757d-65ed-411c-aaab-4220c112c3d8
362024-09-23T23:12:45.605ZINFOcrucible-agent (datafile): region e617757d-65ed-411c-aaab-4220c112c3d8 state: Created -> Tombstoned
372024-09-23T23:12:45.606ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-09-23T23:12:45.606ZINFOcrucible-agent (dropshot): request completed latency_us = 19265 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:61942 req_id = 86c6c046-5173-489f-b40a-ee7019ab3374 response_code = 204 uri = /crucible/0/regions/e617757d-65ed-411c-aaab-4220c112c3d8
392024-09-23T23:12:45.607ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e617757d-65ed-411c-aaab-4220c112c3d8 (instance states: (Some(Online), None))
402024-09-23T23:12:45.609ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61942 req_id = a42e7b3a-9480-4759-b9ee-f120688e1cee response_code = 200 uri = /crucible/0/regions/e617757d-65ed-411c-aaab-4220c112c3d8
412024-09-23T23:12:45.611ZINFOcrucible-agent (worker): SMF ok!
422024-09-23T23:12:45.621ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible/regions/e617757d-65ed-411c-aaab-4220c112c3d8" region = e617757d-65ed-411c-aaab-4220c112c3d8
432024-09-23T23:12:45.685ZINFOcrucible-agent (datafile): region e617757d-65ed-411c-aaab-4220c112c3d8 state: Tombstoned -> Destroyed
442024-09-23T23:12:45.715ZINFOcrucible-agent (dropshot): request completed latency_us = 671 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61942 req_id = b6c78ab3-a7df-4e39-b5f1-2250773b7884 response_code = 200 uri = /crucible/0/regions/e617757d-65ed-411c-aaab-4220c112c3d8
452024-09-23T23:13:40.556ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:45565
462024-09-23T23:13:40.556ZINFOcrucible-agent (datafile): region 192f05bc-462d-4c7c-9cca-1b1bfc2111b1 state: Requested
472024-09-23T23:13:40.556ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-09-23T23:13:40.556ZINFOcrucible-agent (dropshot): request completed latency_us = 230 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45565 req_id = 0886f3f7-b532-4ec3-8add-1ca00207bcd2 response_code = 200 uri = /crucible/0/regions
492024-09-23T23:13:40.565ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible/regions/192f05bc-462d-4c7c-9cca-1b1bfc2111b1
502024-09-23T23:13:40.565ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible/regions/192f05bc-462d-4c7c-9cca-1b1bfc2111b1
512024-09-23T23:13:40.614ZINFOcrucible-agent (worker): creating region Region { id: RegionId("192f05bc-462d-4c7c-9cca-1b1bfc2111b1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/192f05bc-462d-4c7c-9cca-1b1bfc2111b1" region = 192f05bc-462d-4c7c-9cca-1b1bfc2111b1
522024-09-23T23:13:40.614ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "192f05bc-462d-4c7c-9cca-1b1bfc2111b1" "--data" "/data/regions/192f05bc-462d-4c7c-9cca-1b1bfc2111b1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 192f05bc-462d-4c7c-9cca-1b1bfc2111b1
532024-09-23T23:13:40.700ZINFOcrucible-agent (worker): region files created ok region = 192f05bc-462d-4c7c-9cca-1b1bfc2111b1
542024-09-23T23:13:40.700ZINFOcrucible-agent (datafile): region 192f05bc-462d-4c7c-9cca-1b1bfc2111b1 state: Requested -> Created
552024-09-23T23:13:40.700ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-09-23T23:13:40.702ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-192f05bc-462d-4c7c-9cca-1b1bfc2111b1
572024-09-23T23:13:40.705ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-192f05bc-462d-4c7c-9cca-1b1bfc2111b1
582024-09-23T23:13:40.714ZINFOcrucible-agent (worker): creating config property group
592024-09-23T23:13:40.721ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-192f05bc-462d-4c7c-9cca-1b1bfc2111b1
602024-09-23T23:13:40.721ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/192f05bc-462d-4c7c-9cca-1b1bfc2111b1
612024-09-23T23:13:40.722ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-09-23T23:13:40.722ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
632024-09-23T23:13:40.722ZINFOcrucible-agent (worker): commit
642024-09-23T23:13:40.726ZINFOcrucible-agent (worker): ok!
652024-09-23T23:13:40.732ZINFOcrucible-agent (worker): SMF ok!
662024-09-23T23:13:40.856ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45565 req_id = 0d1488f3-28f2-4dcf-ba2b-105d1070298e response_code = 200 uri = /crucible/0/regions