Max level shown:
1 [ Mar 30 04:07:16 Enabled. ]
2 [ Mar 30 04:07:16 Rereading configuration. ]
3 [ Mar 30 04:07:17 Rereading configuration. ]
4 [ Mar 30 04:07:18 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_121748b7-d12c-483c-bb9b-e9f8929f1ec8/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-30T04:07:19.108ZINFOcrucible-agent: dataset: "oxp_121748b7-d12c-483c-bb9b-e9f8929f1ec8/crucible"
72024-03-30T04:07:19.108ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-03-30T04:07:19.108ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-30T04:07:19.210ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
102024-03-30T04:14:01.310ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:40231
112024-03-30T04:14:01.348ZINFOcrucible-agent (datafile): region 14ec998f-5d7b-4a3b-a534-3ba7dad5465d state: Requested
122024-03-30T04:14:01.353ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
132024-03-30T04:14:01.353ZINFOcrucible-agent (dropshot): request completed latency_us = 12233 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40231 req_id = 9e65bb45-8867-48e1-a0a8-0315224a19e2 response_code = 200 uri = /crucible/0/regions
142024-03-30T04:14:01.367ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_121748b7-d12c-483c-bb9b-e9f8929f1ec8/crucible/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d
152024-03-30T04:14:01.367ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_121748b7-d12c-483c-bb9b-e9f8929f1ec8/crucible/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d
162024-03-30T04:14:01.418ZINFOcrucible-agent (worker): creating region Region { id: RegionId("14ec998f-5d7b-4a3b-a534-3ba7dad5465d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d" region = 14ec998f-5d7b-4a3b-a534-3ba7dad5465d
172024-03-30T04:14:01.605ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40231 req_id = 2a39c788-5ed1-429e-9ee1-9e0085c2643c response_code = 200 uri = /crucible/0/regions
182024-03-30T04:14:01.704ZINFOcrucible-agent (worker): region files created ok region = 14ec998f-5d7b-4a3b-a534-3ba7dad5465d
192024-03-30T04:14:01.704ZINFOcrucible-agent (datafile): region 14ec998f-5d7b-4a3b-a534-3ba7dad5465d state: Requested -> Created
202024-03-30T04:14:01.704ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-03-30T04:14:01.704ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-14ec998f-5d7b-4a3b-a534-3ba7dad5465d
222024-03-30T04:14:01.709ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-14ec998f-5d7b-4a3b-a534-3ba7dad5465d
232024-03-30T04:14:01.725ZINFOcrucible-agent (worker): creating config property group
242024-03-30T04:14:01.728ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-14ec998f-5d7b-4a3b-a534-3ba7dad5465d
252024-03-30T04:14:01.729ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d
262024-03-30T04:14:01.729ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-03-30T04:14:01.729ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
282024-03-30T04:14:01.729ZINFOcrucible-agent (worker): commit
292024-03-30T04:14:01.733ZINFOcrucible-agent (worker): ok!
302024-03-30T04:14:01.746ZINFOcrucible-agent (worker): SMF ok!
312024-03-30T04:14:01.867ZINFOcrucible-agent (dropshot): request completed latency_us = 1002 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40231 req_id = d0bf8dcc-2eb8-44cb-916d-4d184bf27ac4 response_code = 200 uri = /crucible/0/regions
322024-03-30T04:14:25.141ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:54885
332024-03-30T04:14:25.141ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54885 req_id = ae31f334-e000-4360-aa6b-40e5f2fb6123 response_code = 200 uri = /crucible/0/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d
342024-03-30T04:14:25.142ZINFOcrucible-agent (datafile): path is "/data/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d"
352024-03-30T04:14:25.151ZINFOcrucible-agent (datafile): dataset is oxp_121748b7-d12c-483c-bb9b-e9f8929f1ec8/crucible/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d
362024-03-30T04:14:25.160ZINFOcrucible-agent (datafile): region 14ec998f-5d7b-4a3b-a534-3ba7dad5465d state: Created -> Tombstoned
372024-03-30T04:14:25.160ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-03-30T04:14:25.160ZINFOcrucible-agent (dropshot): request completed latency_us = 19114 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:54885 req_id = ec455e05-93ff-491b-a98f-819d4772facb response_code = 204 uri = /crucible/0/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d
392024-03-30T04:14:25.160ZINFOcrucible-agent (dropshot): request completed latency_us = 39 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54885 req_id = f6e9d84c-9bce-458c-a837-57f563aaba4c response_code = 200 uri = /crucible/0/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d
402024-03-30T04:14:25.161ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-14ec998f-5d7b-4a3b-a534-3ba7dad5465d (instance states: (Some(Online), None))
412024-03-30T04:14:25.165ZINFOcrucible-agent (worker): SMF ok!
422024-03-30T04:14:25.175ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_121748b7-d12c-483c-bb9b-e9f8929f1ec8/crucible/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d" region = 14ec998f-5d7b-4a3b-a534-3ba7dad5465d
432024-03-30T04:14:25.219ZINFOcrucible-agent (datafile): region 14ec998f-5d7b-4a3b-a534-3ba7dad5465d state: Tombstoned -> Destroyed
442024-03-30T04:14:25.226ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54885 req_id = 8bf26f00-9401-445e-a2ac-d79543124c24 response_code = 200 uri = /crucible/0/regions/14ec998f-5d7b-4a3b-a534-3ba7dad5465d