Max level shown:
1 [ Dec 21 07:14:17 Enabled. ]
2 [ Dec 21 07:14:17 Rereading configuration. ]
3 [ Dec 21 07:14:19 Rereading configuration. ]
4 [ Dec 21 07:14:23 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_a7ec2557-40ae-4bde-baff-8883298d9fcc/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-21T07:14:23.455ZINFOcrucible-agent: dataset: "oxp_a7ec2557-40ae-4bde-baff-8883298d9fcc/crucible"
72024-12-21T07:14:23.459ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-12-21T07:14:23.459ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-21T07:14:23.477ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-21T07:14:23.556ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112024-12-21T07:14:52.631ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:33097
122024-12-21T07:14:52.649ZINFOcrucible-agent (datafile): region 6b544587-a5c0-402b-920c-9b5f7166ce2c state: Requested
132024-12-21T07:14:52.653ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-12-21T07:14:52.658ZINFOcrucible-agent (dropshot): request completed latency_us = 11732 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33097 req_id = 022bf113-a236-40db-8a6c-973a73e28273 response_code = 200 uri = /crucible/0/regions
152024-12-21T07:14:52.665ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_a7ec2557-40ae-4bde-baff-8883298d9fcc/crucible/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c
162024-12-21T07:14:52.665ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_a7ec2557-40ae-4bde-baff-8883298d9fcc/crucible/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c
172024-12-21T07:14:52.743ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6b544587-a5c0-402b-920c-9b5f7166ce2c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c" region = 6b544587-a5c0-402b-920c-9b5f7166ce2c
182024-12-21T07:14:52.744ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6b544587-a5c0-402b-920c-9b5f7166ce2c" "--data" "/data/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 6b544587-a5c0-402b-920c-9b5f7166ce2c
192024-12-21T07:14:52.807ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33097 req_id = 128fa3aa-94c1-4bf3-b74c-b5a46030e145 response_code = 200 uri = /crucible/0/regions
202024-12-21T07:14:52.879ZINFOcrucible-agent (worker): region files created ok region = 6b544587-a5c0-402b-920c-9b5f7166ce2c
212024-12-21T07:14:52.879ZINFOcrucible-agent (datafile): region 6b544587-a5c0-402b-920c-9b5f7166ce2c state: Requested -> Created
222024-12-21T07:14:52.879ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-12-21T07:14:52.879ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6b544587-a5c0-402b-920c-9b5f7166ce2c
242024-12-21T07:14:52.886ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6b544587-a5c0-402b-920c-9b5f7166ce2c
252024-12-21T07:14:52.898ZINFOcrucible-agent (worker): creating config property group
262024-12-21T07:14:52.903ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6b544587-a5c0-402b-920c-9b5f7166ce2c
272024-12-21T07:14:52.904ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c
282024-12-21T07:14:52.904ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-12-21T07:14:52.904ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302024-12-21T07:14:52.904ZINFOcrucible-agent (worker): commit
312024-12-21T07:14:52.910ZINFOcrucible-agent (worker): ok!
322024-12-21T07:14:52.919ZINFOcrucible-agent (worker): SMF ok!
332024-12-21T07:14:53.542ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33097 req_id = 197a5d9a-2c3c-46a2-8118-1fa5b46bb5cb response_code = 200 uri = /crucible/0/regions
342024-12-21T07:14:54.007ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33097 req_id = 38abcfa8-1e8a-4b5d-8676-98a15cb89ce1 response_code = 200 uri = /crucible/0/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c
352024-12-21T07:14:54.011ZINFOcrucible-agent (datafile): path is "/data/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c"
362024-12-21T07:14:54.022ZINFOcrucible-agent (datafile): dataset is oxp_a7ec2557-40ae-4bde-baff-8883298d9fcc/crucible/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c
372024-12-21T07:14:54.034ZINFOcrucible-agent (datafile): region 6b544587-a5c0-402b-920c-9b5f7166ce2c state: Created -> Tombstoned
382024-12-21T07:14:54.034ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-12-21T07:14:54.035ZINFOcrucible-agent (dropshot): request completed latency_us = 23839 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:33097 req_id = de545f73-3470-4a6c-b3fb-aa5e24ca4572 response_code = 204 uri = /crucible/0/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c
402024-12-21T07:14:54.038ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6b544587-a5c0-402b-920c-9b5f7166ce2c (instance states: (Some(Online), None))
412024-12-21T07:14:54.039ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33097 req_id = b88d38bf-f8da-4f96-9067-c36d2b5d149f response_code = 200 uri = /crucible/0/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c
422024-12-21T07:14:54.045ZINFOcrucible-agent (worker): SMF ok!
432024-12-21T07:14:54.057ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_a7ec2557-40ae-4bde-baff-8883298d9fcc/crucible/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c" region = 6b544587-a5c0-402b-920c-9b5f7166ce2c
442024-12-21T07:14:54.105ZINFOcrucible-agent (dropshot): request completed latency_us = 96 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33097 req_id = 0047dbc8-4422-4b65-a969-18985c6357b0 response_code = 200 uri = /crucible/0/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c
452024-12-21T07:14:54.134ZINFOcrucible-agent (datafile): region 6b544587-a5c0-402b-920c-9b5f7166ce2c state: Tombstoned -> Destroyed
462024-12-21T07:14:54.226ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33097 req_id = f74bfa24-73ce-477e-b373-c340c5d77ec8 response_code = 200 uri = /crucible/0/regions/6b544587-a5c0-402b-920c-9b5f7166ce2c