Max level shown:
1 [ Jul 10 20:02:45 Enabled. ]
2 [ Jul 10 20:02:45 Rereading configuration. ]
3 [ Jul 10 20:02:46 Rereading configuration. ]
4 [ Jul 10 20:02:48 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_c50a0442-8d96-40c6-91eb-e3a7f4bff366/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-10T20:02:48.782ZINFOcrucible-agent: dataset: "oxp_c50a0442-8d96-40c6-91eb-e3a7f4bff366/crucible"
72024-07-10T20:02:48.787ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-07-10T20:02:48.787ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-10T20:02:48.808ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-10T20:02:48.877ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-07-10T20:03:13.536ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:61808
122024-07-10T20:03:13.556ZINFOcrucible-agent (datafile): region e51d5658-8ff1-40d8-a072-dafdc1aaa10e state: Requested
132024-07-10T20:03:13.561ZINFOcrucible-agent (dropshot): request completed latency_us = 13523 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61808 req_id = 5d077ed3-4cd2-4b52-87dc-db4940f5ea8a response_code = 200 uri = /crucible/0/regions
142024-07-10T20:03:13.561ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-07-10T20:03:13.575ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_c50a0442-8d96-40c6-91eb-e3a7f4bff366/crucible/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e
162024-07-10T20:03:13.575ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_c50a0442-8d96-40c6-91eb-e3a7f4bff366/crucible/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e
172024-07-10T20:03:13.667ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e51d5658-8ff1-40d8-a072-dafdc1aaa10e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e" region = e51d5658-8ff1-40d8-a072-dafdc1aaa10e
182024-07-10T20:03:13.669ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e51d5658-8ff1-40d8-a072-dafdc1aaa10e" "--data" "/data/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = e51d5658-8ff1-40d8-a072-dafdc1aaa10e
192024-07-10T20:03:13.875ZINFOcrucible-agent (worker): region files created ok region = e51d5658-8ff1-40d8-a072-dafdc1aaa10e
202024-07-10T20:03:13.875ZINFOcrucible-agent (datafile): region e51d5658-8ff1-40d8-a072-dafdc1aaa10e state: Requested -> Created
212024-07-10T20:03:13.876ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-07-10T20:03:13.876ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e51d5658-8ff1-40d8-a072-dafdc1aaa10e
232024-07-10T20:03:13.896ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e51d5658-8ff1-40d8-a072-dafdc1aaa10e
242024-07-10T20:03:13.909ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61808 req_id = 2651c17f-663c-432a-b251-5d8f956cd1ce response_code = 200 uri = /crucible/0/regions
252024-07-10T20:03:13.937ZINFOcrucible-agent (worker): creating config property group
262024-07-10T20:03:13.958ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e51d5658-8ff1-40d8-a072-dafdc1aaa10e
272024-07-10T20:03:13.959ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e
282024-07-10T20:03:13.963ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-10T20:03:13.963ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
302024-07-10T20:03:13.963ZINFOcrucible-agent (worker): commit
312024-07-10T20:03:14.006ZINFOcrucible-agent (worker): ok!
322024-07-10T20:03:14.025ZINFOcrucible-agent (worker): SMF ok!
332024-07-10T20:03:15.550ZINFOcrucible-agent (dropshot): request completed latency_us = 110 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61808 req_id = e5786fde-feb3-4156-9ea7-174f05041fdf response_code = 200 uri = /crucible/0/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e
342024-07-10T20:03:15.553ZINFOcrucible-agent (datafile): path is "/data/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e"
352024-07-10T20:03:15.563ZINFOcrucible-agent (datafile): dataset is oxp_c50a0442-8d96-40c6-91eb-e3a7f4bff366/crucible/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e
362024-07-10T20:03:15.572ZINFOcrucible-agent (datafile): region e51d5658-8ff1-40d8-a072-dafdc1aaa10e state: Created -> Tombstoned
372024-07-10T20:03:15.573ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-07-10T20:03:15.573ZINFOcrucible-agent (dropshot): request completed latency_us = 19540 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:61808 req_id = c542aadc-1b47-47fe-8a1d-c2134cb8ff89 response_code = 204 uri = /crucible/0/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e
392024-07-10T20:03:15.574ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e51d5658-8ff1-40d8-a072-dafdc1aaa10e (instance states: (Some(Online), None))
402024-07-10T20:03:15.575ZINFOcrucible-agent (dropshot): request completed latency_us = 577 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61808 req_id = e0aebe42-8cde-46b9-83b2-6a78fc8637a8 response_code = 200 uri = /crucible/0/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e
412024-07-10T20:03:15.598ZINFOcrucible-agent (worker): SMF ok!
422024-07-10T20:03:15.607ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c50a0442-8d96-40c6-91eb-e3a7f4bff366/crucible/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e" region = e51d5658-8ff1-40d8-a072-dafdc1aaa10e
432024-07-10T20:03:15.683ZINFOcrucible-agent (datafile): region e51d5658-8ff1-40d8-a072-dafdc1aaa10e state: Tombstoned -> Destroyed
442024-07-10T20:03:15.690ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61808 req_id = a910b151-d01e-419e-990b-37ac2bf6a314 response_code = 200 uri = /crucible/0/regions/e51d5658-8ff1-40d8-a072-dafdc1aaa10e
452024-07-10T20:09:21.298ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:63966
462024-07-10T20:09:21.298ZINFOcrucible-agent (datafile): region 0e99b425-d51d-4f9e-be7e-42fd3639810e state: Requested
472024-07-10T20:09:21.301ZINFOcrucible-agent (dropshot): request completed latency_us = 2904 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63966 req_id = 2d125321-7449-46f0-8721-2f536e2816c1 response_code = 200 uri = /crucible/0/regions
482024-07-10T20:09:21.301ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-07-10T20:09:21.311ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c50a0442-8d96-40c6-91eb-e3a7f4bff366/crucible/regions/0e99b425-d51d-4f9e-be7e-42fd3639810e
502024-07-10T20:09:21.311ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c50a0442-8d96-40c6-91eb-e3a7f4bff366/crucible/regions/0e99b425-d51d-4f9e-be7e-42fd3639810e
512024-07-10T20:09:21.362ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0e99b425-d51d-4f9e-be7e-42fd3639810e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0e99b425-d51d-4f9e-be7e-42fd3639810e" region = 0e99b425-d51d-4f9e-be7e-42fd3639810e
522024-07-10T20:09:21.364ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0e99b425-d51d-4f9e-be7e-42fd3639810e" "--data" "/data/regions/0e99b425-d51d-4f9e-be7e-42fd3639810e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0e99b425-d51d-4f9e-be7e-42fd3639810e
532024-07-10T20:09:21.425ZINFOcrucible-agent (worker): region files created ok region = 0e99b425-d51d-4f9e-be7e-42fd3639810e
542024-07-10T20:09:21.425ZINFOcrucible-agent (datafile): region 0e99b425-d51d-4f9e-be7e-42fd3639810e state: Requested -> Created
552024-07-10T20:09:21.425ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-07-10T20:09:21.426ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0e99b425-d51d-4f9e-be7e-42fd3639810e
572024-07-10T20:09:21.431ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0e99b425-d51d-4f9e-be7e-42fd3639810e
582024-07-10T20:09:21.446ZINFOcrucible-agent (worker): creating config property group
592024-07-10T20:09:21.449ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0e99b425-d51d-4f9e-be7e-42fd3639810e
602024-07-10T20:09:21.449ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0e99b425-d51d-4f9e-be7e-42fd3639810e
612024-07-10T20:09:21.449ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-07-10T20:09:21.449ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
632024-07-10T20:09:21.449ZINFOcrucible-agent (worker): commit
642024-07-10T20:09:21.452ZINFOcrucible-agent (worker): ok!
652024-07-10T20:09:21.457ZINFOcrucible-agent (worker): SMF ok!
662024-07-10T20:09:21.509ZINFOcrucible-agent (dropshot): request completed latency_us = 643 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63966 req_id = a54f5ab9-d3d1-4d9c-8840-54f6e1ae30db response_code = 200 uri = /crucible/0/regions