Max level shown:
1 [ Apr 26 00:20:11 Enabled. ]
2 [ Apr 26 00:20:11 Rereading configuration. ]
3 [ Apr 26 00:20:12 Rereading configuration. ]
4 [ Apr 26 00:20:15 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-04-26T00:20:15.378ZINFOcrucible-agent: dataset: "oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible"
72024-04-26T00:20:15.384ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
82024-04-26T00:20:15.384ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-04-26T00:20:15.405ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-04-26T00:20:15.486ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
112024-04-26T00:21:26.542ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:38212
122024-04-26T00:21:26.571ZINFOcrucible-agent (datafile): region b77a18b4-2d7a-440b-af34-14c007849a99 state: Requested
132024-04-26T00:21:26.574ZINFOcrucible-agent (dropshot): request completed latency_us = 6511 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38212 req_id = d90b056a-14c3-4733-80e7-05c22a609037 response_code = 200 uri = /crucible/0/regions
142024-04-26T00:21:26.574ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-04-26T00:21:26.586ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible/regions/b77a18b4-2d7a-440b-af34-14c007849a99
162024-04-26T00:21:26.586ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible/regions/b77a18b4-2d7a-440b-af34-14c007849a99
172024-04-26T00:21:26.641ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b77a18b4-2d7a-440b-af34-14c007849a99"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b77a18b4-2d7a-440b-af34-14c007849a99" region = b77a18b4-2d7a-440b-af34-14c007849a99
182024-04-26T00:21:26.643ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b77a18b4-2d7a-440b-af34-14c007849a99" "--data" "/data/regions/b77a18b4-2d7a-440b-af34-14c007849a99" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b77a18b4-2d7a-440b-af34-14c007849a99
192024-04-26T00:21:26.703ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38212 req_id = 699636c2-dd4a-4207-ac51-537141ca4abb response_code = 200 uri = /crucible/0/regions
202024-04-26T00:21:26.785ZINFOcrucible-agent (worker): region files created ok region = b77a18b4-2d7a-440b-af34-14c007849a99
212024-04-26T00:21:26.785ZINFOcrucible-agent (datafile): region b77a18b4-2d7a-440b-af34-14c007849a99 state: Requested -> Created
222024-04-26T00:21:26.785ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-04-26T00:21:26.786ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b77a18b4-2d7a-440b-af34-14c007849a99
242024-04-26T00:21:26.790ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b77a18b4-2d7a-440b-af34-14c007849a99
252024-04-26T00:21:26.801ZINFOcrucible-agent (worker): creating config property group
262024-04-26T00:21:26.806ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b77a18b4-2d7a-440b-af34-14c007849a99
272024-04-26T00:21:26.807ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b77a18b4-2d7a-440b-af34-14c007849a99
282024-04-26T00:21:26.809ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-04-26T00:21:26.809ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
302024-04-26T00:21:26.809ZINFOcrucible-agent (worker): commit
312024-04-26T00:21:26.816ZINFOcrucible-agent (worker): ok!
322024-04-26T00:21:26.820ZINFOcrucible-agent (worker): SMF ok!
332024-04-26T00:21:27.121ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38212 req_id = e68fdfa2-e6be-41b2-839e-2e336c216036 response_code = 200 uri = /crucible/0/regions
342024-04-26T00:26:56.746ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:58614
352024-04-26T00:26:56.749ZINFOcrucible-agent (dropshot): request completed latency_us = 2603 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58614 req_id = dde66ae8-7cbd-42f1-9294-a8cc65cd15e9 response_code = 200 uri = /crucible/0/regions/b77a18b4-2d7a-440b-af34-14c007849a99
362024-04-26T00:26:56.751ZINFOcrucible-agent (datafile): path is "/data/regions/b77a18b4-2d7a-440b-af34-14c007849a99"
372024-04-26T00:26:56.761ZINFOcrucible-agent (datafile): dataset is oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible/regions/b77a18b4-2d7a-440b-af34-14c007849a99
382024-04-26T00:26:56.770ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible/regions/b77a18b4-2d7a-440b-af34-14c007849a99@8a8cb26d-a12c-47cb-a73a-5f6e4573a290
392024-04-26T00:26:56.770ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible/regions/b77a18b4-2d7a-440b-af34-14c007849a99", "8a8cb26d-a12c-47cb-a73a-5f6e4573a290"]
402024-04-26T00:26:56.781ZINFOcrucible-agent (dropshot): request completed latency_us = 32291 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58614 req_id = df9cdebc-957c-4603-94c5-a50d6aeabba4 response_code = 200 uri = /crucible/0/regions/b77a18b4-2d7a-440b-af34-14c007849a99/snapshots/8a8cb26d-a12c-47cb-a73a-5f6e4573a290
412024-04-26T00:26:56.781ZINFOcrucible-agent (datafile): path is "/data/regions/b77a18b4-2d7a-440b-af34-14c007849a99"
422024-04-26T00:26:56.790ZINFOcrucible-agent (datafile): dataset is oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible/regions/b77a18b4-2d7a-440b-af34-14c007849a99
432024-04-26T00:26:56.799ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible/regions/b77a18b4-2d7a-440b-af34-14c007849a99@8a8cb26d-a12c-47cb-a73a-5f6e4573a290
442024-04-26T00:26:56.799ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_73bca2cf-2bf8-443a-bf93-681a0fe6b326/crucible/regions/b77a18b4-2d7a-440b-af34-14c007849a99", "8a8cb26d-a12c-47cb-a73a-5f6e4573a290"]
452024-04-26T00:26:56.808ZINFOcrucible-agent (datafile): requesting running snapshot b77a18b4-2d7a-440b-af34-14c007849a99-8a8cb26d-a12c-47cb-a73a-5f6e4573a290 state: Requested
462024-04-26T00:26:56.808ZINFOcrucible-agent (worker): applying SMF actions for region b77a18b4-2d7a-440b-af34-14c007849a99 running snapshot 8a8cb26d-a12c-47cb-a73a-5f6e4573a290 (state Requested)...
472024-04-26T00:26:56.811ZINFOcrucible-agent (dropshot): request completed latency_us = 29343 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58614 req_id = b9300874-06ef-4f73-832b-6d79e96cbca4 response_code = 200 uri = /crucible/0/regions/b77a18b4-2d7a-440b-af34-14c007849a99/snapshots/8a8cb26d-a12c-47cb-a73a-5f6e4573a290/run
482024-04-26T00:26:56.818ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b77a18b4-2d7a-440b-af34-14c007849a99
492024-04-26T00:26:56.818ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
502024-04-26T00:26:56.818ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::1a
512024-04-26T00:26:56.818ZINFOcrucible-agent (worker): reconfig required
522024-04-26T00:26:56.818ZINFOcrucible-agent (worker): using existing config property group
532024-04-26T00:26:56.818ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b77a18b4-2d7a-440b-af34-14c007849a99
542024-04-26T00:26:56.818ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b77a18b4-2d7a-440b-af34-14c007849a99
552024-04-26T00:26:56.818ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
562024-04-26T00:26:56.818ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
572024-04-26T00:26:56.818ZINFOcrucible-agent (worker): commit
582024-04-26T00:26:56.825ZINFOcrucible-agent (worker): ok!
592024-04-26T00:26:56.825ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b77a18b4-2d7a-440b-af34-14c007849a99-8a8cb26d-a12c-47cb-a73a-5f6e4573a290
602024-04-26T00:26:56.828ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b77a18b4-2d7a-440b-af34-14c007849a99-8a8cb26d-a12c-47cb-a73a-5f6e4573a290
612024-04-26T00:26:56.841ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b77a18b4-2d7a-440b-af34-14c007849a99-8a8cb26d-a12c-47cb-a73a-5f6e4573a290
622024-04-26T00:26:56.841ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b77a18b4-2d7a-440b-af34-14c007849a99/.zfs/snapshot/8a8cb26d-a12c-47cb-a73a-5f6e4573a290
632024-04-26T00:26:56.841ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
642024-04-26T00:26:56.841ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-04-26T00:26:56.841ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
662024-04-26T00:26:56.842ZINFOcrucible-agent (worker): commit
672024-04-26T00:26:56.845ZINFOcrucible-agent (worker): ok!
682024-04-26T00:26:56.850ZINFOcrucible-agent (worker): SMF ok!
692024-04-26T00:26:56.850ZINFOcrucible-agent (datafile): region b77a18b4-2d7a-440b-af34-14c007849a99 running snapshot 8a8cb26d-a12c-47cb-a73a-5f6e4573a290 state: Requested -> Created