Max level shown:
12024-08-06T04:00:49.213ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:52903
22024-08-06T04:00:49.236ZINFOcrucible-agent (datafile): region b0a7b580-18e9-4756-882f-f188a0f5d965 state: Requested
32024-08-06T04:00:49.241ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42024-08-06T04:00:49.245ZINFOcrucible-agent (dropshot): request completed latency_us = 15029 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52903 req_id = 1d5fc6cd-34de-4a85-917e-1d1f245ee892 response_code = 200 uri = /crucible/0/regions
52024-08-06T04:00:49.253ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_bba14577-1020-45ea-adb9-712c3357062d/crucible/regions/b0a7b580-18e9-4756-882f-f188a0f5d965
62024-08-06T04:00:49.253ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_bba14577-1020-45ea-adb9-712c3357062d/crucible/regions/b0a7b580-18e9-4756-882f-f188a0f5d965
72024-08-06T04:00:49.330ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b0a7b580-18e9-4756-882f-f188a0f5d965"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b0a7b580-18e9-4756-882f-f188a0f5d965" region = b0a7b580-18e9-4756-882f-f188a0f5d965
82024-08-06T04:00:49.332ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b0a7b580-18e9-4756-882f-f188a0f5d965" "--data" "/data/regions/b0a7b580-18e9-4756-882f-f188a0f5d965" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = b0a7b580-18e9-4756-882f-f188a0f5d965
92024-08-06T04:00:49.442ZINFOcrucible-agent (worker): region files created ok region = b0a7b580-18e9-4756-882f-f188a0f5d965
102024-08-06T04:00:49.442ZINFOcrucible-agent (datafile): region b0a7b580-18e9-4756-882f-f188a0f5d965 state: Requested -> Created
112024-08-06T04:00:49.442ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-08-06T04:00:49.443ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b0a7b580-18e9-4756-882f-f188a0f5d965
132024-08-06T04:00:49.448ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b0a7b580-18e9-4756-882f-f188a0f5d965
142024-08-06T04:00:49.462ZINFOcrucible-agent (dropshot): request completed latency_us = 95 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52903 req_id = 95887d11-75db-4955-9e55-a4c849d581f6 response_code = 200 uri = /crucible/0/regions
152024-08-06T04:00:49.466ZINFOcrucible-agent (worker): creating config property group
162024-08-06T04:00:49.471ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b0a7b580-18e9-4756-882f-f188a0f5d965
172024-08-06T04:00:49.481ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b0a7b580-18e9-4756-882f-f188a0f5d965
182024-08-06T04:00:49.483ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-08-06T04:00:49.483ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202024-08-06T04:00:49.483ZINFOcrucible-agent (worker): commit
212024-08-06T04:00:49.488ZINFOcrucible-agent (worker): ok!
222024-08-06T04:00:49.492ZINFOcrucible-agent (worker): SMF ok!
232024-08-06T04:00:50.013ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52903 req_id = 669706fd-55ad-4c09-bfd9-ebe768e2c651 response_code = 200 uri = /crucible/0/regions/b0a7b580-18e9-4756-882f-f188a0f5d965
242024-08-06T04:00:50.016ZINFOcrucible-agent (datafile): path is "/data/regions/b0a7b580-18e9-4756-882f-f188a0f5d965"
252024-08-06T04:00:50.025ZINFOcrucible-agent (datafile): dataset is oxp_bba14577-1020-45ea-adb9-712c3357062d/crucible/regions/b0a7b580-18e9-4756-882f-f188a0f5d965
262024-08-06T04:00:50.034ZINFOcrucible-agent (datafile): region b0a7b580-18e9-4756-882f-f188a0f5d965 state: Created -> Tombstoned
272024-08-06T04:00:50.034ZINFOcrucible-agent (worker): applying SMF actions before removal...
282024-08-06T04:00:50.034ZINFOcrucible-agent (dropshot): request completed latency_us = 19344 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:52903 req_id = 810b988d-0e2f-437c-a06d-a653397cb9a2 response_code = 204 uri = /crucible/0/regions/b0a7b580-18e9-4756-882f-f188a0f5d965
292024-08-06T04:00:50.035ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b0a7b580-18e9-4756-882f-f188a0f5d965 (instance states: (Some(Online), None))
302024-08-06T04:00:50.037ZINFOcrucible-agent (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52903 req_id = a39cd32d-b3dc-4907-8749-341b679edb1b response_code = 200 uri = /crucible/0/regions/b0a7b580-18e9-4756-882f-f188a0f5d965
312024-08-06T04:00:50.040ZINFOcrucible-agent (worker): SMF ok!
322024-08-06T04:00:50.050ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_bba14577-1020-45ea-adb9-712c3357062d/crucible/regions/b0a7b580-18e9-4756-882f-f188a0f5d965" region = b0a7b580-18e9-4756-882f-f188a0f5d965
332024-08-06T04:00:50.115ZINFOcrucible-agent (datafile): region b0a7b580-18e9-4756-882f-f188a0f5d965 state: Tombstoned -> Destroyed
342024-08-06T04:00:50.154ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52903 req_id = d0e1b6d5-2569-47e3-9b91-ac9c1401658f response_code = 200 uri = /crucible/0/regions/b0a7b580-18e9-4756-882f-f188a0f5d965
352024-08-06T04:06:30.234ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:37450
362024-08-06T04:06:30.235ZINFOcrucible-agent (datafile): region 73de18ee-1912-4149-835a-07576d99e377 state: Requested
372024-08-06T04:06:30.235ZINFOcrucible-agent (dropshot): request completed latency_us = 1279 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37450 req_id = 63947ad5-f3fd-41ff-b302-5a4280762277 response_code = 200 uri = /crucible/0/regions
382024-08-06T04:06:30.235ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
392024-08-06T04:06:30.245ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_bba14577-1020-45ea-adb9-712c3357062d/crucible/regions/73de18ee-1912-4149-835a-07576d99e377
402024-08-06T04:06:30.246ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_bba14577-1020-45ea-adb9-712c3357062d/crucible/regions/73de18ee-1912-4149-835a-07576d99e377
412024-08-06T04:06:30.301ZINFOcrucible-agent (worker): creating region Region { id: RegionId("73de18ee-1912-4149-835a-07576d99e377"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/73de18ee-1912-4149-835a-07576d99e377" region = 73de18ee-1912-4149-835a-07576d99e377
422024-08-06T04:06:30.303ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "73de18ee-1912-4149-835a-07576d99e377" "--data" "/data/regions/73de18ee-1912-4149-835a-07576d99e377" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 73de18ee-1912-4149-835a-07576d99e377
432024-08-06T04:06:30.372ZINFOcrucible-agent (worker): region files created ok region = 73de18ee-1912-4149-835a-07576d99e377
442024-08-06T04:06:30.372ZINFOcrucible-agent (datafile): region 73de18ee-1912-4149-835a-07576d99e377 state: Requested -> Created
452024-08-06T04:06:30.372ZINFOcrucible-agent (worker): applying SMF actions post create...
462024-08-06T04:06:30.373ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-73de18ee-1912-4149-835a-07576d99e377
472024-08-06T04:06:30.378ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-73de18ee-1912-4149-835a-07576d99e377
482024-08-06T04:06:30.391ZINFOcrucible-agent (worker): creating config property group
492024-08-06T04:06:30.394ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-73de18ee-1912-4149-835a-07576d99e377
502024-08-06T04:06:30.394ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/73de18ee-1912-4149-835a-07576d99e377
512024-08-06T04:06:30.394ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522024-08-06T04:06:30.394ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
532024-08-06T04:06:30.394ZINFOcrucible-agent (worker): commit
542024-08-06T04:06:30.398ZINFOcrucible-agent (worker): ok!
552024-08-06T04:06:30.402ZINFOcrucible-agent (worker): SMF ok!
562024-08-06T04:06:30.477ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37450 req_id = a168a47d-c5a8-4d83-9f61-c804bb28cac8 response_code = 200 uri = /crucible/0/regions