Max level shown:
1 [ Mar 22 20:02:53 Enabled. ]
2 [ Mar 22 20:02:53 Rereading configuration. ]
3 [ Mar 22 20:02:55 Rereading configuration. ]
4 [ Mar 22 20:02:59 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_e547dfd9-383a-4325-8a47-dcb22ef84e0c/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-03-22T20:02:59.674ZINFOcrucible-agent: dataset: "oxp_e547dfd9-383a-4325-8a47-dcb22ef84e0c/crucible"
72025-03-22T20:02:59.677ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82025-03-22T20:02:59.677ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-03-22T20:02:59.694ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-03-22T20:02:59.797ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112025-03-22T20:14:29.960ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:54003
122025-03-22T20:14:30.003ZINFOcrucible-agent (datafile): region 7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5 state: Requested
132025-03-22T20:14:30.009ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142025-03-22T20:14:30.009ZINFOcrucible-agent (dropshot): request completed latency_us = 18483 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54003 req_id = d0a03e34-97ab-46a1-af61-bc1c07d5ac3c response_code = 200 uri = /crucible/0/regions
152025-03-22T20:14:30.019ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e547dfd9-383a-4325-8a47-dcb22ef84e0c/crucible/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
162025-03-22T20:14:30.020ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e547dfd9-383a-4325-8a47-dcb22ef84e0c/crucible/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
172025-03-22T20:14:30.065ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5" region = 7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
182025-03-22T20:14:30.067ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5" "--data" "/data/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
192025-03-22T20:14:30.331ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54003 req_id = 5b385e16-df70-489f-91b7-9fd3be652301 response_code = 200 uri = /crucible/0/regions
202025-03-22T20:14:30.382ZINFOcrucible-agent (worker): region files created ok region = 7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
212025-03-22T20:14:30.382ZINFOcrucible-agent (datafile): region 7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5 state: Requested -> Created
222025-03-22T20:14:30.382ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-03-22T20:14:30.382ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
242025-03-22T20:14:30.387ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
252025-03-22T20:14:30.400ZINFOcrucible-agent (worker): creating config property group
262025-03-22T20:14:30.402ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
272025-03-22T20:14:30.403ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
282025-03-22T20:14:30.403ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-03-22T20:14:30.403ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
302025-03-22T20:14:30.403ZINFOcrucible-agent (worker): commit
312025-03-22T20:14:30.407ZINFOcrucible-agent (worker): ok!
322025-03-22T20:14:30.420ZINFOcrucible-agent (worker): SMF ok!
332025-03-22T20:14:31.073ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54003 req_id = 3aea77b4-a1e0-4dcf-b60b-dae5f703a7fa response_code = 200 uri = /crucible/0/regions
342025-03-22T20:14:55.547ZINFOcrucible-agent (dropshot): request completed latency_us = 2399 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54003 req_id = ae09725d-1179-446b-aef6-23d70794a3d9 response_code = 200 uri = /crucible/0/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
352025-03-22T20:14:55.550ZINFOcrucible-agent (datafile): path is "/data/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5"
362025-03-22T20:14:55.562ZINFOcrucible-agent (datafile): dataset is oxp_e547dfd9-383a-4325-8a47-dcb22ef84e0c/crucible/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
372025-03-22T20:14:55.572ZINFOcrucible-agent (datafile): region 7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5 state: Created -> Tombstoned
382025-03-22T20:14:55.572ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-03-22T20:14:55.572ZINFOcrucible-agent (dropshot): request completed latency_us = 21519 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:54003 req_id = 80f4f563-0e7a-464d-9b35-93c85ce45cce response_code = 204 uri = /crucible/0/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
402025-03-22T20:14:55.573ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5 (instance states: (Some(Online), None))
412025-03-22T20:14:55.575ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54003 req_id = 0206c735-4c36-49a6-a112-1ad63a8fe8a1 response_code = 200 uri = /crucible/0/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
422025-03-22T20:14:55.577ZINFOcrucible-agent (worker): SMF ok!
432025-03-22T20:14:55.590ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_e547dfd9-383a-4325-8a47-dcb22ef84e0c/crucible/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5" region = 7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5
442025-03-22T20:14:55.643ZINFOcrucible-agent (datafile): region 7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5 state: Tombstoned -> Destroyed
452025-03-22T20:14:55.720ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54003 req_id = 745c1264-1a3e-48ab-816d-cdd951dc4977 response_code = 200 uri = /crucible/0/regions/7cf64b31-e0d7-4f3b-9bce-b959faa4d9d5