Max level shown:
12024-06-20T21:34:54.309ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:58543
22024-06-20T21:34:54.341ZINFOcrucible-agent (datafile): region 8fdd6d03-c314-434b-b92c-5c529dce7570 state: Requested
32024-06-20T21:34:54.348ZINFOcrucible-agent (dropshot): request completed latency_us = 15762 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58543 req_id = d3855387-4cce-4323-ba23-b2ca64314702 response_code = 200 uri = /crucible/0/regions
42024-06-20T21:34:54.349ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-06-20T21:34:54.364ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ff7b7614-aeaa-4dfa-8c5e-e5115ba48aa0/crucible/regions/8fdd6d03-c314-434b-b92c-5c529dce7570
62024-06-20T21:34:54.364ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ff7b7614-aeaa-4dfa-8c5e-e5115ba48aa0/crucible/regions/8fdd6d03-c314-434b-b92c-5c529dce7570
72024-06-20T21:34:54.419ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8fdd6d03-c314-434b-b92c-5c529dce7570"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8fdd6d03-c314-434b-b92c-5c529dce7570" region = 8fdd6d03-c314-434b-b92c-5c529dce7570
82024-06-20T21:34:54.421ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8fdd6d03-c314-434b-b92c-5c529dce7570" "--data" "/data/regions/8fdd6d03-c314-434b-b92c-5c529dce7570" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8fdd6d03-c314-434b-b92c-5c529dce7570
92024-06-20T21:34:54.632ZINFOcrucible-agent (dropshot): request completed latency_us = 664 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58543 req_id = 47061a4f-eafd-44a1-ba8f-df8a71259795 response_code = 200 uri = /crucible/0/regions
102024-06-20T21:34:54.762ZINFOcrucible-agent (worker): region files created ok region = 8fdd6d03-c314-434b-b92c-5c529dce7570
112024-06-20T21:34:54.762ZINFOcrucible-agent (datafile): region 8fdd6d03-c314-434b-b92c-5c529dce7570 state: Requested -> Created
122024-06-20T21:34:54.762ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-06-20T21:34:54.763ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8fdd6d03-c314-434b-b92c-5c529dce7570
142024-06-20T21:34:54.772ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8fdd6d03-c314-434b-b92c-5c529dce7570
152024-06-20T21:34:54.790ZINFOcrucible-agent (worker): creating config property group
162024-06-20T21:34:54.804ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8fdd6d03-c314-434b-b92c-5c529dce7570
172024-06-20T21:34:54.805ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8fdd6d03-c314-434b-b92c-5c529dce7570
182024-06-20T21:34:54.808ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-06-20T21:34:54.808ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202024-06-20T21:34:54.808ZINFOcrucible-agent (worker): commit
212024-06-20T21:34:54.813ZINFOcrucible-agent (worker): ok!
222024-06-20T21:34:54.818ZINFOcrucible-agent (worker): SMF ok!
232024-06-20T21:34:55.144ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58543 req_id = 9467392b-61b3-4f0b-aea0-7f51c63810e6 response_code = 200 uri = /crucible/0/regions
242024-06-20T21:34:58.632ZINFOcrucible-agent (datafile): region 5535c362-28a4-4bb3-b219-28259d8a18f5 state: Requested
252024-06-20T21:34:58.632ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262024-06-20T21:34:58.632ZINFOcrucible-agent (dropshot): request completed latency_us = 677 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58543 req_id = ff3ef81d-18d0-4d96-a1ce-c674ddc0be58 response_code = 200 uri = /crucible/0/regions
272024-06-20T21:34:58.642ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ff7b7614-aeaa-4dfa-8c5e-e5115ba48aa0/crucible/regions/5535c362-28a4-4bb3-b219-28259d8a18f5
282024-06-20T21:34:58.642ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ff7b7614-aeaa-4dfa-8c5e-e5115ba48aa0/crucible/regions/5535c362-28a4-4bb3-b219-28259d8a18f5
292024-06-20T21:34:58.715ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5535c362-28a4-4bb3-b219-28259d8a18f5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5535c362-28a4-4bb3-b219-28259d8a18f5" region = 5535c362-28a4-4bb3-b219-28259d8a18f5
302024-06-20T21:34:58.715ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5535c362-28a4-4bb3-b219-28259d8a18f5" "--data" "/data/regions/5535c362-28a4-4bb3-b219-28259d8a18f5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5535c362-28a4-4bb3-b219-28259d8a18f5
312024-06-20T21:34:58.792ZINFOcrucible-agent (dropshot): request completed latency_us = 697 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58543 req_id = f07994c4-bb77-4eab-9786-f45291beee9a response_code = 200 uri = /crucible/0/regions
322024-06-20T21:34:58.795ZINFOcrucible-agent (worker): region files created ok region = 5535c362-28a4-4bb3-b219-28259d8a18f5
332024-06-20T21:34:58.795ZINFOcrucible-agent (datafile): region 5535c362-28a4-4bb3-b219-28259d8a18f5 state: Requested -> Created
342024-06-20T21:34:58.795ZINFOcrucible-agent (worker): applying SMF actions post create...
352024-06-20T21:34:58.796ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5535c362-28a4-4bb3-b219-28259d8a18f5
362024-06-20T21:34:58.800ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5535c362-28a4-4bb3-b219-28259d8a18f5
372024-06-20T21:34:58.810ZINFOcrucible-agent (worker): creating config property group
382024-06-20T21:34:58.813ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5535c362-28a4-4bb3-b219-28259d8a18f5
392024-06-20T21:34:58.813ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5535c362-28a4-4bb3-b219-28259d8a18f5
402024-06-20T21:34:58.813ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412024-06-20T21:34:58.813ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
422024-06-20T21:34:58.813ZINFOcrucible-agent (worker): commit
432024-06-20T21:34:58.817ZINFOcrucible-agent (worker): ok!
442024-06-20T21:34:58.821ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/8fdd6d03-c314-434b-b92c-5c529dce7570
452024-06-20T21:34:58.822ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
462024-06-20T21:34:58.822ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::1a
472024-06-20T21:34:58.822ZINFOcrucible-agent (worker): reconfig required
482024-06-20T21:34:58.822ZINFOcrucible-agent (worker): using existing config property group
492024-06-20T21:34:58.822ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8fdd6d03-c314-434b-b92c-5c529dce7570
502024-06-20T21:34:58.822ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8fdd6d03-c314-434b-b92c-5c529dce7570
512024-06-20T21:34:58.822ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522024-06-20T21:34:58.822ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
532024-06-20T21:34:58.822ZINFOcrucible-agent (worker): commit
542024-06-20T21:34:58.830ZINFOcrucible-agent (worker): ok!
552024-06-20T21:34:58.830ZINFOcrucible-agent (worker): SMF ok!
562024-06-20T21:34:59.527ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58543 req_id = 2be7c090-224b-42cd-b1c1-1135dfeaf0d6 response_code = 200 uri = /crucible/0/regions
572024-06-20T21:35:25.742ZINFOcrucible-agent (dropshot): request completed latency_us = 104 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58543 req_id = 550de545-d204-4a3e-8e08-3fff7bfda29f response_code = 200 uri = /crucible/0/regions/5535c362-28a4-4bb3-b219-28259d8a18f5
582024-06-20T21:35:25.745ZINFOcrucible-agent (datafile): path is "/data/regions/5535c362-28a4-4bb3-b219-28259d8a18f5"
592024-06-20T21:35:25.755ZINFOcrucible-agent (datafile): dataset is oxp_ff7b7614-aeaa-4dfa-8c5e-e5115ba48aa0/crucible/regions/5535c362-28a4-4bb3-b219-28259d8a18f5
602024-06-20T21:35:25.764ZINFOcrucible-agent (datafile): region 5535c362-28a4-4bb3-b219-28259d8a18f5 state: Created -> Tombstoned
612024-06-20T21:35:25.764ZINFOcrucible-agent (worker): applying SMF actions before removal...
622024-06-20T21:35:25.765ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5535c362-28a4-4bb3-b219-28259d8a18f5 (instance states: (Some(Online), None))
632024-06-20T21:35:25.766ZINFOcrucible-agent (dropshot): request completed latency_us = 21405 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58543 req_id = 580c2004-8456-47d3-80f2-34ff08c2d7c9 response_code = 204 uri = /crucible/0/regions/5535c362-28a4-4bb3-b219-28259d8a18f5
642024-06-20T21:35:25.769ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58543 req_id = 1eb6f4f4-2e64-47ec-9e28-0c7dbc165a6f response_code = 200 uri = /crucible/0/regions/5535c362-28a4-4bb3-b219-28259d8a18f5
652024-06-20T21:35:25.773ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/8fdd6d03-c314-434b-b92c-5c529dce7570
662024-06-20T21:35:25.773ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
672024-06-20T21:35:25.773ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::1a
682024-06-20T21:35:25.773ZINFOcrucible-agent (worker): reconfig required
692024-06-20T21:35:25.773ZINFOcrucible-agent (worker): using existing config property group
702024-06-20T21:35:25.773ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8fdd6d03-c314-434b-b92c-5c529dce7570
712024-06-20T21:35:25.774ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8fdd6d03-c314-434b-b92c-5c529dce7570
722024-06-20T21:35:25.774ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
732024-06-20T21:35:25.774ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
742024-06-20T21:35:25.774ZINFOcrucible-agent (worker): commit
752024-06-20T21:35:25.781ZINFOcrucible-agent (worker): ok!
762024-06-20T21:35:25.782ZINFOcrucible-agent (worker): SMF ok!
772024-06-20T21:35:25.791ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ff7b7614-aeaa-4dfa-8c5e-e5115ba48aa0/crucible/regions/5535c362-28a4-4bb3-b219-28259d8a18f5" region = 5535c362-28a4-4bb3-b219-28259d8a18f5
782024-06-20T21:35:25.843ZINFOcrucible-agent (datafile): region 5535c362-28a4-4bb3-b219-28259d8a18f5 state: Tombstoned -> Destroyed
792024-06-20T21:35:25.854ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58543 req_id = bc6136a8-6574-4b2a-80be-78a5678c2545 response_code = 200 uri = /crucible/0/regions/5535c362-28a4-4bb3-b219-28259d8a18f5