Max level shown:
12024-12-21T07:26:21.961ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:49537
22024-12-21T07:26:22.014ZINFOcrucible-agent (datafile): region 634de7dc-b27c-40b8-9b27-23bb6d695511 state: Requested
32024-12-21T07:26:22.019ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-21T07:26:22.024ZINFOcrucible-agent (dropshot): request completed latency_us = 16076 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49537 req_id = 1e2635d1-f3a2-4882-be63-209bdd7df56c response_code = 200 uri = /crucible/0/regions
52024-12-21T07:26:22.033ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_dd752c54-3bb3-4391-a54e-55a8557a18e5/crucible/regions/634de7dc-b27c-40b8-9b27-23bb6d695511
62024-12-21T07:26:22.033ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_dd752c54-3bb3-4391-a54e-55a8557a18e5/crucible/regions/634de7dc-b27c-40b8-9b27-23bb6d695511
72024-12-21T07:26:22.082ZINFOcrucible-agent (worker): creating region Region { id: RegionId("634de7dc-b27c-40b8-9b27-23bb6d695511"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/634de7dc-b27c-40b8-9b27-23bb6d695511" region = 634de7dc-b27c-40b8-9b27-23bb6d695511
82024-12-21T07:26:22.085ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "634de7dc-b27c-40b8-9b27-23bb6d695511" "--data" "/data/regions/634de7dc-b27c-40b8-9b27-23bb6d695511" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 634de7dc-b27c-40b8-9b27-23bb6d695511
92024-12-21T07:26:22.356ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49537 req_id = 6bcda5ff-87ae-449f-9db3-81ae91028f24 response_code = 200 uri = /crucible/0/regions
102024-12-21T07:26:22.383ZINFOcrucible-agent (worker): region files created ok region = 634de7dc-b27c-40b8-9b27-23bb6d695511
112024-12-21T07:26:22.383ZINFOcrucible-agent (datafile): region 634de7dc-b27c-40b8-9b27-23bb6d695511 state: Requested -> Created
122024-12-21T07:26:22.383ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-12-21T07:26:22.384ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-634de7dc-b27c-40b8-9b27-23bb6d695511
142024-12-21T07:26:22.394ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-634de7dc-b27c-40b8-9b27-23bb6d695511
152024-12-21T07:26:22.414ZINFOcrucible-agent (worker): creating config property group
162024-12-21T07:26:22.418ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-634de7dc-b27c-40b8-9b27-23bb6d695511
172024-12-21T07:26:22.418ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/634de7dc-b27c-40b8-9b27-23bb6d695511
182024-12-21T07:26:22.418ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-12-21T07:26:22.418ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202024-12-21T07:26:22.418ZINFOcrucible-agent (worker): commit
212024-12-21T07:26:22.427ZINFOcrucible-agent (worker): ok!
222024-12-21T07:26:22.431ZINFOcrucible-agent (worker): SMF ok!
232024-12-21T07:26:22.640ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49537 req_id = bce01a29-0dcc-4da0-8aa5-4b251ca2f3da response_code = 200 uri = /crucible/0/regions
242024-12-21T07:26:27.894ZINFOcrucible-agent (datafile): region 682ac16d-6311-4e1d-a002-8224d1604e40 state: Requested
252024-12-21T07:26:27.894ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262024-12-21T07:26:27.894ZINFOcrucible-agent (dropshot): request completed latency_us = 232 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49537 req_id = 2602e970-698d-4ccb-9f5e-2c28d2acaa00 response_code = 200 uri = /crucible/0/regions
272024-12-21T07:26:27.904ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_dd752c54-3bb3-4391-a54e-55a8557a18e5/crucible/regions/682ac16d-6311-4e1d-a002-8224d1604e40
282024-12-21T07:26:27.904ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_dd752c54-3bb3-4391-a54e-55a8557a18e5/crucible/regions/682ac16d-6311-4e1d-a002-8224d1604e40
292024-12-21T07:26:27.951ZINFOcrucible-agent (worker): creating region Region { id: RegionId("682ac16d-6311-4e1d-a002-8224d1604e40"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/682ac16d-6311-4e1d-a002-8224d1604e40" region = 682ac16d-6311-4e1d-a002-8224d1604e40
302024-12-21T07:26:27.951ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "682ac16d-6311-4e1d-a002-8224d1604e40" "--data" "/data/regions/682ac16d-6311-4e1d-a002-8224d1604e40" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 682ac16d-6311-4e1d-a002-8224d1604e40
312024-12-21T07:26:28.031ZINFOcrucible-agent (worker): region files created ok region = 682ac16d-6311-4e1d-a002-8224d1604e40
322024-12-21T07:26:28.031ZINFOcrucible-agent (datafile): region 682ac16d-6311-4e1d-a002-8224d1604e40 state: Requested -> Created
332024-12-21T07:26:28.031ZINFOcrucible-agent (worker): applying SMF actions post create...
342024-12-21T07:26:28.036ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-682ac16d-6311-4e1d-a002-8224d1604e40
352024-12-21T07:26:28.039ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-682ac16d-6311-4e1d-a002-8224d1604e40
362024-12-21T07:26:28.048ZINFOcrucible-agent (worker): creating config property group
372024-12-21T07:26:28.052ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-682ac16d-6311-4e1d-a002-8224d1604e40
382024-12-21T07:26:28.052ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/682ac16d-6311-4e1d-a002-8224d1604e40
392024-12-21T07:26:28.052ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402024-12-21T07:26:28.052ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
412024-12-21T07:26:28.052ZINFOcrucible-agent (worker): commit
422024-12-21T07:26:28.056ZINFOcrucible-agent (worker): ok!
432024-12-21T07:26:28.056ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49537 req_id = 1b2935df-2e67-44e4-8bc2-0b4d6f0c42f6 response_code = 200 uri = /crucible/0/regions
442024-12-21T07:26:28.060ZINFOcrucible-agent (worker): SMF ok!
452024-12-21T07:26:54.271ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49537 req_id = b6d9c366-5b88-4293-8377-554385aa738e response_code = 200 uri = /crucible/0/regions/682ac16d-6311-4e1d-a002-8224d1604e40
462024-12-21T07:26:54.275ZINFOcrucible-agent (datafile): path is "/data/regions/682ac16d-6311-4e1d-a002-8224d1604e40"
472024-12-21T07:26:54.287ZINFOcrucible-agent (datafile): dataset is oxp_dd752c54-3bb3-4391-a54e-55a8557a18e5/crucible/regions/682ac16d-6311-4e1d-a002-8224d1604e40
482024-12-21T07:26:54.297ZINFOcrucible-agent (datafile): region 682ac16d-6311-4e1d-a002-8224d1604e40 state: Created -> Tombstoned
492024-12-21T07:26:54.298ZINFOcrucible-agent (worker): applying SMF actions before removal...
502024-12-21T07:26:54.298ZINFOcrucible-agent (dropshot): request completed latency_us = 22469 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:49537 req_id = eaf6f8f1-fa2f-46c4-a2c9-1e44364470f3 response_code = 204 uri = /crucible/0/regions/682ac16d-6311-4e1d-a002-8224d1604e40
512024-12-21T07:26:54.299ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-682ac16d-6311-4e1d-a002-8224d1604e40 (instance states: (Some(Online), None))
522024-12-21T07:26:54.301ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49537 req_id = 2f217bea-07a3-48ea-9917-17742d2c8bee response_code = 200 uri = /crucible/0/regions/682ac16d-6311-4e1d-a002-8224d1604e40
532024-12-21T07:26:54.305ZINFOcrucible-agent (worker): SMF ok!
542024-12-21T07:26:54.316ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_dd752c54-3bb3-4391-a54e-55a8557a18e5/crucible/regions/682ac16d-6311-4e1d-a002-8224d1604e40" region = 682ac16d-6311-4e1d-a002-8224d1604e40
552024-12-21T07:26:54.368ZINFOcrucible-agent (datafile): region 682ac16d-6311-4e1d-a002-8224d1604e40 state: Tombstoned -> Destroyed
562024-12-21T07:26:54.411ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49537 req_id = f24d68ca-73e5-461b-a26c-35d716feeba4 response_code = 200 uri = /crucible/0/regions/682ac16d-6311-4e1d-a002-8224d1604e40