Max level shown:
12024-06-28T23:47:07.144ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:51795
22024-06-28T23:47:07.170ZINFOcrucible-agent (datafile): region 1fdfae07-a29e-4889-883f-a4a72aad72c1 state: Requested
32024-06-28T23:47:07.184ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-06-28T23:47:07.184ZINFOcrucible-agent (dropshot): request completed latency_us = 25713 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51795 req_id = 72de9ae5-c513-480c-8315-626f08a722f2 response_code = 200 uri = /crucible/0/regions
52024-06-28T23:47:07.199ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e34e55ab-24df-4dfd-a432-391a86874efb/crucible/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1
62024-06-28T23:47:07.199ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e34e55ab-24df-4dfd-a432-391a86874efb/crucible/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1
72024-06-28T23:47:07.262ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1fdfae07-a29e-4889-883f-a4a72aad72c1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1" region = 1fdfae07-a29e-4889-883f-a4a72aad72c1
82024-06-28T23:47:07.265ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1fdfae07-a29e-4889-883f-a4a72aad72c1" "--data" "/data/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1fdfae07-a29e-4889-883f-a4a72aad72c1
92024-06-28T23:47:07.383ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51795 req_id = 119d5282-6f41-41ca-8594-140fdf704cd4 response_code = 200 uri = /crucible/0/regions
102024-06-28T23:47:07.591ZINFOcrucible-agent (worker): region files created ok region = 1fdfae07-a29e-4889-883f-a4a72aad72c1
112024-06-28T23:47:07.591ZINFOcrucible-agent (datafile): region 1fdfae07-a29e-4889-883f-a4a72aad72c1 state: Requested -> Created
122024-06-28T23:47:07.591ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-06-28T23:47:07.592ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1fdfae07-a29e-4889-883f-a4a72aad72c1
142024-06-28T23:47:07.603ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1fdfae07-a29e-4889-883f-a4a72aad72c1
152024-06-28T23:47:07.626ZINFOcrucible-agent (worker): creating config property group
162024-06-28T23:47:07.630ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1fdfae07-a29e-4889-883f-a4a72aad72c1
172024-06-28T23:47:07.631ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1
182024-06-28T23:47:07.634ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-06-28T23:47:07.634ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202024-06-28T23:47:07.634ZINFOcrucible-agent (worker): commit
212024-06-28T23:47:07.650ZINFOcrucible-agent (worker): ok!
222024-06-28T23:47:07.659ZINFOcrucible-agent (worker): SMF ok!
232024-06-28T23:47:08.016ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51795 req_id = efab70de-3118-4f48-ab15-ca24c17c312c response_code = 200 uri = /crucible/0/regions
242024-06-28T23:47:12.241ZINFOcrucible-agent (datafile): region e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3 state: Requested
252024-06-28T23:47:12.241ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262024-06-28T23:47:12.241ZINFOcrucible-agent (dropshot): request completed latency_us = 849 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51795 req_id = f9e5344f-bb20-4d35-b40f-330a61d4f495 response_code = 200 uri = /crucible/0/regions
272024-06-28T23:47:12.251ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e34e55ab-24df-4dfd-a432-391a86874efb/crucible/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
282024-06-28T23:47:12.251ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e34e55ab-24df-4dfd-a432-391a86874efb/crucible/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
292024-06-28T23:47:12.339ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3" region = e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
302024-06-28T23:47:12.339ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3" "--data" "/data/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
312024-06-28T23:47:12.511ZINFOcrucible-agent (dropshot): request completed latency_us = 718 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51795 req_id = e538b18a-b3f0-406c-adb2-d56508159845 response_code = 200 uri = /crucible/0/regions
322024-06-28T23:47:12.515ZINFOcrucible-agent (worker): region files created ok region = e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
332024-06-28T23:47:12.515ZINFOcrucible-agent (datafile): region e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3 state: Requested -> Created
342024-06-28T23:47:12.516ZINFOcrucible-agent (worker): applying SMF actions post create...
352024-06-28T23:47:12.517ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1
362024-06-28T23:47:12.517ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
372024-06-28T23:47:12.517ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::17
382024-06-28T23:47:12.517ZINFOcrucible-agent (worker): reconfig required
392024-06-28T23:47:12.517ZINFOcrucible-agent (worker): using existing config property group
402024-06-28T23:47:12.517ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1fdfae07-a29e-4889-883f-a4a72aad72c1
412024-06-28T23:47:12.517ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1
422024-06-28T23:47:12.517ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
432024-06-28T23:47:12.517ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
442024-06-28T23:47:12.517ZINFOcrucible-agent (worker): commit
452024-06-28T23:47:12.543ZINFOcrucible-agent (worker): ok!
462024-06-28T23:47:12.544ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
472024-06-28T23:47:12.557ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
482024-06-28T23:47:12.582ZINFOcrucible-agent (worker): creating config property group
492024-06-28T23:47:12.594ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
502024-06-28T23:47:12.594ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
512024-06-28T23:47:12.594ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
522024-06-28T23:47:12.594ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
532024-06-28T23:47:12.594ZINFOcrucible-agent (worker): commit
542024-06-28T23:47:12.606ZINFOcrucible-agent (worker): ok!
552024-06-28T23:47:12.620ZINFOcrucible-agent (worker): SMF ok!
562024-06-28T23:47:13.097ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51795 req_id = 3bdb15c6-831c-4b2d-b85f-c7ac5230f20e response_code = 200 uri = /crucible/0/regions
572024-06-28T23:47:38.703ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51795 req_id = 8ae331f6-932d-45c1-bfb5-65c6827d40b9 response_code = 200 uri = /crucible/0/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
582024-06-28T23:47:38.705ZINFOcrucible-agent (datafile): path is "/data/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3"
592024-06-28T23:47:38.715ZINFOcrucible-agent (datafile): dataset is oxp_e34e55ab-24df-4dfd-a432-391a86874efb/crucible/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
602024-06-28T23:47:38.724ZINFOcrucible-agent (datafile): region e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3 state: Created -> Tombstoned
612024-06-28T23:47:38.724ZINFOcrucible-agent (worker): applying SMF actions before removal...
622024-06-28T23:47:38.724ZINFOcrucible-agent (dropshot): request completed latency_us = 18759 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:51795 req_id = 98180ee6-63ec-4912-bcc3-7a2e703da050 response_code = 204 uri = /crucible/0/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
632024-06-28T23:47:38.725ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3 (instance states: (Some(Online), None))
642024-06-28T23:47:38.726ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51795 req_id = a3bfa8f2-b358-48b5-8093-250a8f350966 response_code = 200 uri = /crucible/0/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
652024-06-28T23:47:38.733ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1
662024-06-28T23:47:38.733ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
672024-06-28T23:47:38.733ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::17
682024-06-28T23:47:38.733ZINFOcrucible-agent (worker): reconfig required
692024-06-28T23:47:38.733ZINFOcrucible-agent (worker): using existing config property group
702024-06-28T23:47:38.733ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1fdfae07-a29e-4889-883f-a4a72aad72c1
712024-06-28T23:47:38.733ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1fdfae07-a29e-4889-883f-a4a72aad72c1
722024-06-28T23:47:38.733ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
732024-06-28T23:47:38.733ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
742024-06-28T23:47:38.734ZINFOcrucible-agent (worker): commit
752024-06-28T23:47:38.742ZINFOcrucible-agent (worker): ok!
762024-06-28T23:47:38.743ZINFOcrucible-agent (worker): SMF ok!
772024-06-28T23:47:38.751ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_e34e55ab-24df-4dfd-a432-391a86874efb/crucible/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3" region = e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3
782024-06-28T23:47:38.797ZINFOcrucible-agent (datafile): region e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3 state: Tombstoned -> Destroyed
792024-06-28T23:47:38.853ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51795 req_id = 97805e48-b29a-4408-a95f-384fabef2215 response_code = 200 uri = /crucible/0/regions/e68c85b5-ca59-4f13-bf7a-00b4bd0e7dc3