Max level shown:
12025-11-12T23:16:27.568ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:53512
22025-11-12T23:16:27.617ZINFOcrucible-agent (datafile): region a731c5cf-bccc-444d-9a0b-1ed9b17ada88 state: Requested
32025-11-12T23:16:27.624ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-11-12T23:16:27.624ZINFOcrucible-agent (dropshot): request completed latency_us = 26521 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 19e3b6b2-5708-4835-99eb-d2e2bcfef6f9 response_code = 200 uri = /crucible/0/regions
52025-11-12T23:16:27.635ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f4ef9696-c034-4f43-8203-40e43adf81c3/crucible/regions/a731c5cf-bccc-444d-9a0b-1ed9b17ada88
62025-11-12T23:16:27.635ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f4ef9696-c034-4f43-8203-40e43adf81c3/crucible/regions/a731c5cf-bccc-444d-9a0b-1ed9b17ada88
72025-11-12T23:16:27.689ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a731c5cf-bccc-444d-9a0b-1ed9b17ada88"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a731c5cf-bccc-444d-9a0b-1ed9b17ada88" region = a731c5cf-bccc-444d-9a0b-1ed9b17ada88
82025-11-12T23:16:27.691ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a731c5cf-bccc-444d-9a0b-1ed9b17ada88" "--data" "/data/regions/a731c5cf-bccc-444d-9a0b-1ed9b17ada88" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a731c5cf-bccc-444d-9a0b-1ed9b17ada88
92025-11-12T23:16:27.973ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 76aecc52-2c84-43dc-9e16-574b74e4e7a5 response_code = 200 uri = /crucible/0/regions
102025-11-12T23:16:27.993ZINFOcrucible-agent (worker): region files created ok region = a731c5cf-bccc-444d-9a0b-1ed9b17ada88
112025-11-12T23:16:27.993ZINFOcrucible-agent (datafile): region a731c5cf-bccc-444d-9a0b-1ed9b17ada88 state: Requested -> Created
122025-11-12T23:16:27.993ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-11-12T23:16:27.993ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a731c5cf-bccc-444d-9a0b-1ed9b17ada88
142025-11-12T23:16:28.005ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a731c5cf-bccc-444d-9a0b-1ed9b17ada88
152025-11-12T23:16:28.027ZINFOcrucible-agent (worker): creating config property group
162025-11-12T23:16:28.030ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a731c5cf-bccc-444d-9a0b-1ed9b17ada88
172025-11-12T23:16:28.031ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a731c5cf-bccc-444d-9a0b-1ed9b17ada88
182025-11-12T23:16:28.031ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-11-12T23:16:28.031ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202025-11-12T23:16:28.031ZINFOcrucible-agent (worker): commit
212025-11-12T23:16:28.035ZINFOcrucible-agent (worker): ok!
222025-11-12T23:16:28.039ZINFOcrucible-agent (worker): SMF ok!
232025-11-12T23:16:28.675ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53512 req_id = dbec2e2a-1089-4107-8513-f2a1e34f03aa response_code = 200 uri = /crucible/0/regions
242025-11-12T23:16:34.584ZINFOcrucible-agent (datafile): region 33d634fd-29b2-48d7-a9aa-8578397ddbcb state: Requested
252025-11-12T23:16:34.584ZINFOcrucible-agent (dropshot): request completed latency_us = 224 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53512 req_id = c2473c6b-3beb-420c-b566-b293f1fda1ed response_code = 200 uri = /crucible/0/regions
262025-11-12T23:16:34.584ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-11-12T23:16:34.591ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f4ef9696-c034-4f43-8203-40e43adf81c3/crucible/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
282025-11-12T23:16:34.591ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f4ef9696-c034-4f43-8203-40e43adf81c3/crucible/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
292025-11-12T23:16:34.646ZINFOcrucible-agent (worker): creating region Region { id: RegionId("33d634fd-29b2-48d7-a9aa-8578397ddbcb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb" region = 33d634fd-29b2-48d7-a9aa-8578397ddbcb
302025-11-12T23:16:34.646ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "33d634fd-29b2-48d7-a9aa-8578397ddbcb" "--data" "/data/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 33d634fd-29b2-48d7-a9aa-8578397ddbcb
312025-11-12T23:16:34.721ZINFOcrucible-agent (worker): region files created ok region = 33d634fd-29b2-48d7-a9aa-8578397ddbcb
322025-11-12T23:16:34.721ZINFOcrucible-agent (datafile): region 33d634fd-29b2-48d7-a9aa-8578397ddbcb state: Requested -> Created
332025-11-12T23:16:34.721ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-11-12T23:16:34.721ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-33d634fd-29b2-48d7-a9aa-8578397ddbcb
352025-11-12T23:16:34.724ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-33d634fd-29b2-48d7-a9aa-8578397ddbcb
362025-11-12T23:16:34.731ZINFOcrucible-agent (worker): creating config property group
372025-11-12T23:16:34.734ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-33d634fd-29b2-48d7-a9aa-8578397ddbcb
382025-11-12T23:16:34.734ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
392025-11-12T23:16:34.734ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-11-12T23:16:34.734ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
412025-11-12T23:16:34.734ZINFOcrucible-agent (worker): commit
422025-11-12T23:16:34.738ZINFOcrucible-agent (worker): ok!
432025-11-12T23:16:34.744ZINFOcrucible-agent (worker): SMF ok!
442025-11-12T23:16:34.768ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 04940f6e-6818-4139-b102-e225f3f3ecd1 response_code = 200 uri = /crucible/0/regions
452025-11-12T23:17:02.434ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 31d9dfd9-1228-4ac4-85ae-744e5c1e9ac6 response_code = 200 uri = /crucible/0/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
462025-11-12T23:17:02.439ZINFOcrucible-agent (datafile): path is "/data/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb"
472025-11-12T23:17:02.458ZINFOcrucible-agent (datafile): dataset is oxp_f4ef9696-c034-4f43-8203-40e43adf81c3/crucible/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
482025-11-12T23:17:02.464ZINFOcrucible-agent (datafile): region 33d634fd-29b2-48d7-a9aa-8578397ddbcb state: Created -> Tombstoned
492025-11-12T23:17:02.464ZINFOcrucible-agent (dropshot): request completed latency_us = 25623 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 1bddfec3-bc81-4b11-b872-d4488df68327 response_code = 204 uri = /crucible/0/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
502025-11-12T23:17:02.464ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-11-12T23:17:02.465ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-33d634fd-29b2-48d7-a9aa-8578397ddbcb (instance states: (Some(Online), None))
522025-11-12T23:17:02.467ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 7cd78311-c01d-4678-a93e-b6bcb5362bd3 response_code = 200 uri = /crucible/0/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
532025-11-12T23:17:02.491ZINFOcrucible-agent (worker): SMF ok!
542025-11-12T23:17:02.497ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f4ef9696-c034-4f43-8203-40e43adf81c3/crucible/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb" region = 33d634fd-29b2-48d7-a9aa-8578397ddbcb
552025-11-12T23:17:02.555ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:53512 req_id = cb7863a6-e85f-41d9-9845-f8751d5a9001 response_code = 200 uri = /crucible/0/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
562025-11-12T23:17:02.627ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 0b0fab30-58b1-4858-a0c7-9bcdab0a4e60 response_code = 200 uri = /crucible/0/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb
572025-11-12T23:17:02.648ZINFOcrucible-agent (datafile): region 33d634fd-29b2-48d7-a9aa-8578397ddbcb state: Tombstoned -> Destroyed
582025-11-12T23:17:02.811ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 449a7040-81c8-433a-bb59-3bbb6e141de2 response_code = 200 uri = /crucible/0/regions/33d634fd-29b2-48d7-a9aa-8578397ddbcb