Max level shown:
1 [ Sep 3 23:51:12 Enabled. ]
2 [ Sep 3 23:51:12 Rereading configuration. ]
3 [ Sep 3 23:51:14 Rereading configuration. ]
4 [ Sep 3 23:51:16 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-09-03T23:51:16.134ZINFOcrucible-agent: dataset: "oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible"
72024-09-03T23:51:16.139ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-09-03T23:51:16.139ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-09-03T23:51:16.191ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-09-03T23:51:16.329ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-09-03T23:51:47.126ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:58719
122024-09-03T23:51:47.149ZINFOcrucible-agent (datafile): region b128659e-11e9-4818-ac59-6c40f50bbd86 state: Requested
132024-09-03T23:51:47.152ZINFOcrucible-agent (dropshot): request completed latency_us = 17461 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58719 req_id = f9ae3f2d-61eb-41e8-85a6-f1be447ac2fe response_code = 200 uri = /crucible/0/regions
142024-09-03T23:51:47.153ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-09-03T23:51:47.162ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible/regions/b128659e-11e9-4818-ac59-6c40f50bbd86
162024-09-03T23:51:47.162ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible/regions/b128659e-11e9-4818-ac59-6c40f50bbd86
172024-09-03T23:51:47.230ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b128659e-11e9-4818-ac59-6c40f50bbd86"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b128659e-11e9-4818-ac59-6c40f50bbd86" region = b128659e-11e9-4818-ac59-6c40f50bbd86
182024-09-03T23:51:47.232ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b128659e-11e9-4818-ac59-6c40f50bbd86" "--data" "/data/regions/b128659e-11e9-4818-ac59-6c40f50bbd86" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = b128659e-11e9-4818-ac59-6c40f50bbd86
192024-09-03T23:51:47.392ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58719 req_id = f628f240-86a7-419d-bfa2-18bbea202b39 response_code = 200 uri = /crucible/0/regions
202024-09-03T23:51:47.531ZINFOcrucible-agent (worker): region files created ok region = b128659e-11e9-4818-ac59-6c40f50bbd86
212024-09-03T23:51:47.531ZINFOcrucible-agent (datafile): region b128659e-11e9-4818-ac59-6c40f50bbd86 state: Requested -> Created
222024-09-03T23:51:47.531ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-09-03T23:51:47.532ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b128659e-11e9-4818-ac59-6c40f50bbd86
242024-09-03T23:51:47.536ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b128659e-11e9-4818-ac59-6c40f50bbd86
252024-09-03T23:51:47.548ZINFOcrucible-agent (worker): creating config property group
262024-09-03T23:51:47.552ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b128659e-11e9-4818-ac59-6c40f50bbd86
272024-09-03T23:51:47.560ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b128659e-11e9-4818-ac59-6c40f50bbd86
282024-09-03T23:51:47.560ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-09-03T23:51:47.560ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
302024-09-03T23:51:47.560ZINFOcrucible-agent (worker): commit
312024-09-03T23:51:47.567ZINFOcrucible-agent (worker): ok!
322024-09-03T23:51:47.573ZINFOcrucible-agent (worker): SMF ok!
332024-09-03T23:51:47.847ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58719 req_id = 9d6cda7f-3e92-485b-86cf-15d3926c1912 response_code = 200 uri = /crucible/0/regions
342024-09-03T23:51:48.289ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58719 req_id = 7d70bc3f-4b93-46b9-8d73-90bf2ac6052b response_code = 200 uri = /crucible/0/regions/b128659e-11e9-4818-ac59-6c40f50bbd86
352024-09-03T23:51:48.291ZINFOcrucible-agent (datafile): path is "/data/regions/b128659e-11e9-4818-ac59-6c40f50bbd86"
362024-09-03T23:51:48.300ZINFOcrucible-agent (datafile): dataset is oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible/regions/b128659e-11e9-4818-ac59-6c40f50bbd86
372024-09-03T23:51:48.309ZINFOcrucible-agent (datafile): region b128659e-11e9-4818-ac59-6c40f50bbd86 state: Created -> Tombstoned
382024-09-03T23:51:48.310ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-09-03T23:51:48.310ZINFOcrucible-agent (dropshot): request completed latency_us = 18588 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58719 req_id = 1f7ef436-0709-48a0-acf6-ec38baccfcf3 response_code = 204 uri = /crucible/0/regions/b128659e-11e9-4818-ac59-6c40f50bbd86
402024-09-03T23:51:48.311ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b128659e-11e9-4818-ac59-6c40f50bbd86 (instance states: (Some(Online), None))
412024-09-03T23:51:48.313ZINFOcrucible-agent (dropshot): request completed latency_us = 21 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58719 req_id = 9676fbe5-8089-4a27-980b-0f7b12ee765d response_code = 200 uri = /crucible/0/regions/b128659e-11e9-4818-ac59-6c40f50bbd86
422024-09-03T23:51:48.315ZINFOcrucible-agent (worker): SMF ok!
432024-09-03T23:51:48.325ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible/regions/b128659e-11e9-4818-ac59-6c40f50bbd86" region = b128659e-11e9-4818-ac59-6c40f50bbd86
442024-09-03T23:51:48.383ZINFOcrucible-agent (datafile): region b128659e-11e9-4818-ac59-6c40f50bbd86 state: Tombstoned -> Destroyed
452024-09-03T23:51:48.439ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58719 req_id = 635f83f1-6262-4f96-a774-862e37b0cb53 response_code = 200 uri = /crucible/0/regions/b128659e-11e9-4818-ac59-6c40f50bbd86
462024-09-03T23:56:55.920ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:36038
472024-09-03T23:56:55.920ZINFOcrucible-agent (datafile): region 00a49176-7458-468b-b5c0-ecec488fedcc state: Requested
482024-09-03T23:56:55.921ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-09-03T23:56:55.921ZINFOcrucible-agent (dropshot): request completed latency_us = 904 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36038 req_id = 6101c4c2-e9d8-43f7-aa5b-9ad440ab1e9a response_code = 200 uri = /crucible/0/regions
502024-09-03T23:56:55.931ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible/regions/00a49176-7458-468b-b5c0-ecec488fedcc
512024-09-03T23:56:55.931ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible/regions/00a49176-7458-468b-b5c0-ecec488fedcc
522024-09-03T23:56:55.982ZINFOcrucible-agent (worker): creating region Region { id: RegionId("00a49176-7458-468b-b5c0-ecec488fedcc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/00a49176-7458-468b-b5c0-ecec488fedcc" region = 00a49176-7458-468b-b5c0-ecec488fedcc
532024-09-03T23:56:55.984ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "00a49176-7458-468b-b5c0-ecec488fedcc" "--data" "/data/regions/00a49176-7458-468b-b5c0-ecec488fedcc" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 00a49176-7458-468b-b5c0-ecec488fedcc
542024-09-03T23:56:56.069ZINFOcrucible-agent (worker): region files created ok region = 00a49176-7458-468b-b5c0-ecec488fedcc
552024-09-03T23:56:56.069ZINFOcrucible-agent (datafile): region 00a49176-7458-468b-b5c0-ecec488fedcc state: Requested -> Created
562024-09-03T23:56:56.069ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-09-03T23:56:56.070ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-00a49176-7458-468b-b5c0-ecec488fedcc
582024-09-03T23:56:56.075ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-00a49176-7458-468b-b5c0-ecec488fedcc
592024-09-03T23:56:56.090ZINFOcrucible-agent (worker): creating config property group
602024-09-03T23:56:56.094ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-00a49176-7458-468b-b5c0-ecec488fedcc
612024-09-03T23:56:56.094ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/00a49176-7458-468b-b5c0-ecec488fedcc
622024-09-03T23:56:56.094ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-09-03T23:56:56.094ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
642024-09-03T23:56:56.094ZINFOcrucible-agent (worker): commit
652024-09-03T23:56:56.097ZINFOcrucible-agent (worker): ok!
662024-09-03T23:56:56.101ZINFOcrucible-agent (worker): SMF ok!
672024-09-03T23:56:56.276ZINFOcrucible-agent (dropshot): request completed latency_us = 716 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36038 req_id = d492cb38-8239-4bec-9d30-20114d6d14f3 response_code = 200 uri = /crucible/0/regions