Max level shown:
1 [ Oct 3 20:31:47 Enabled. ]
2 [ Oct 3 20:31:47 Rereading configuration. ]
3 [ Oct 3 20:31:50 Rereading configuration. ]
4 [ Oct 3 20:31:52 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_12b34c54-e8f4-4b50-a4d7-839f5c9ddbe9/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-03T20:31:52.613ZINFOcrucible-agent: dataset: "oxp_12b34c54-e8f4-4b50-a4d7-839f5c9ddbe9/crucible"
72024-10-03T20:31:52.614ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
82024-10-03T20:31:52.614ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-03T20:31:52.629ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-03T20:31:52.741ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
112024-10-03T20:32:42.219ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:37988
122024-10-03T20:32:42.251ZINFOcrucible-agent (datafile): region ceca784c-cd6e-4f55-b669-eb1bc308b4c3 state: Requested
132024-10-03T20:32:42.256ZINFOcrucible-agent (dropshot): request completed latency_us = 12322 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37988 req_id = 76ece0ed-6ac2-469f-bdd8-3fc250a47965 response_code = 200 uri = /crucible/0/regions
142024-10-03T20:32:42.257ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-10-03T20:32:42.267ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_12b34c54-e8f4-4b50-a4d7-839f5c9ddbe9/crucible/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3
162024-10-03T20:32:42.267ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_12b34c54-e8f4-4b50-a4d7-839f5c9ddbe9/crucible/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3
172024-10-03T20:32:42.316ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ceca784c-cd6e-4f55-b669-eb1bc308b4c3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3" region = ceca784c-cd6e-4f55-b669-eb1bc308b4c3
182024-10-03T20:32:42.320ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ceca784c-cd6e-4f55-b669-eb1bc308b4c3" "--data" "/data/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = ceca784c-cd6e-4f55-b669-eb1bc308b4c3
192024-10-03T20:32:42.430ZINFOcrucible-agent (worker): region files created ok region = ceca784c-cd6e-4f55-b669-eb1bc308b4c3
202024-10-03T20:32:42.430ZINFOcrucible-agent (datafile): region ceca784c-cd6e-4f55-b669-eb1bc308b4c3 state: Requested -> Created
212024-10-03T20:32:42.430ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-10-03T20:32:42.432ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ceca784c-cd6e-4f55-b669-eb1bc308b4c3
232024-10-03T20:32:42.437ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ceca784c-cd6e-4f55-b669-eb1bc308b4c3
242024-10-03T20:32:42.451ZINFOcrucible-agent (worker): creating config property group
252024-10-03T20:32:42.454ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ceca784c-cd6e-4f55-b669-eb1bc308b4c3
262024-10-03T20:32:42.460ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3
272024-10-03T20:32:42.460ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-10-03T20:32:42.460ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
292024-10-03T20:32:42.460ZINFOcrucible-agent (worker): commit
302024-10-03T20:32:42.464ZINFOcrucible-agent (worker): ok!
312024-10-03T20:32:42.468ZINFOcrucible-agent (worker): SMF ok!
322024-10-03T20:32:42.521ZINFOcrucible-agent (dropshot): request completed latency_us = 600 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37988 req_id = 58eb0bee-50a4-4cf4-b4d8-3bd11b89225b response_code = 200 uri = /crucible/0/regions
332024-10-03T20:32:42.849ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37988 req_id = 30919bbf-9a33-4a44-bdf2-7577c056fe5b response_code = 200 uri = /crucible/0/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3
342024-10-03T20:32:42.852ZINFOcrucible-agent (datafile): path is "/data/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3"
352024-10-03T20:32:42.863ZINFOcrucible-agent (datafile): dataset is oxp_12b34c54-e8f4-4b50-a4d7-839f5c9ddbe9/crucible/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3
362024-10-03T20:32:42.872ZINFOcrucible-agent (datafile): region ceca784c-cd6e-4f55-b669-eb1bc308b4c3 state: Created -> Tombstoned
372024-10-03T20:32:42.872ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-10-03T20:32:42.872ZINFOcrucible-agent (dropshot): request completed latency_us = 20327 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:37988 req_id = d84fc366-e26a-4aa9-9045-f320de218671 response_code = 204 uri = /crucible/0/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3
392024-10-03T20:32:42.874ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ceca784c-cd6e-4f55-b669-eb1bc308b4c3 (instance states: (Some(Online), None))
402024-10-03T20:32:42.876ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37988 req_id = ce4f7e26-0bfa-4328-bbbf-c77a53ecc087 response_code = 200 uri = /crucible/0/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3
412024-10-03T20:32:42.879ZINFOcrucible-agent (worker): SMF ok!
422024-10-03T20:32:42.890ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_12b34c54-e8f4-4b50-a4d7-839f5c9ddbe9/crucible/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3" region = ceca784c-cd6e-4f55-b669-eb1bc308b4c3
432024-10-03T20:32:42.944ZINFOcrucible-agent (datafile): region ceca784c-cd6e-4f55-b669-eb1bc308b4c3 state: Tombstoned -> Destroyed
442024-10-03T20:32:43.030ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37988 req_id = 1419c3f6-ed36-4380-bf9a-f47d6417fce2 response_code = 200 uri = /crucible/0/regions/ceca784c-cd6e-4f55-b669-eb1bc308b4c3
452024-10-03T20:36:11.332ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:62654
462024-10-03T20:36:11.332ZINFOcrucible-agent (datafile): region 84b11064-a042-425c-a1a3-f7fba2d9a45c state: Requested
472024-10-03T20:36:11.333ZINFOcrucible-agent (dropshot): request completed latency_us = 997 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62654 req_id = bc578577-97fc-4fe4-a04e-1bb05a673324 response_code = 200 uri = /crucible/0/regions
482024-10-03T20:36:11.333ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-10-03T20:36:11.345ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_12b34c54-e8f4-4b50-a4d7-839f5c9ddbe9/crucible/regions/84b11064-a042-425c-a1a3-f7fba2d9a45c
502024-10-03T20:36:11.345ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_12b34c54-e8f4-4b50-a4d7-839f5c9ddbe9/crucible/regions/84b11064-a042-425c-a1a3-f7fba2d9a45c
512024-10-03T20:36:11.400ZINFOcrucible-agent (worker): creating region Region { id: RegionId("84b11064-a042-425c-a1a3-f7fba2d9a45c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/84b11064-a042-425c-a1a3-f7fba2d9a45c" region = 84b11064-a042-425c-a1a3-f7fba2d9a45c
522024-10-03T20:36:11.402ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "84b11064-a042-425c-a1a3-f7fba2d9a45c" "--data" "/data/regions/84b11064-a042-425c-a1a3-f7fba2d9a45c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 84b11064-a042-425c-a1a3-f7fba2d9a45c
532024-10-03T20:36:11.520ZINFOcrucible-agent (worker): region files created ok region = 84b11064-a042-425c-a1a3-f7fba2d9a45c
542024-10-03T20:36:11.520ZINFOcrucible-agent (datafile): region 84b11064-a042-425c-a1a3-f7fba2d9a45c state: Requested -> Created
552024-10-03T20:36:11.520ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-10-03T20:36:11.521ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-84b11064-a042-425c-a1a3-f7fba2d9a45c
572024-10-03T20:36:11.527ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-84b11064-a042-425c-a1a3-f7fba2d9a45c
582024-10-03T20:36:11.541ZINFOcrucible-agent (worker): creating config property group
592024-10-03T20:36:11.548ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-84b11064-a042-425c-a1a3-f7fba2d9a45c
602024-10-03T20:36:11.549ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/84b11064-a042-425c-a1a3-f7fba2d9a45c
612024-10-03T20:36:11.549ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-10-03T20:36:11.549ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
632024-10-03T20:36:11.549ZINFOcrucible-agent (worker): commit
642024-10-03T20:36:11.556ZINFOcrucible-agent (worker): ok!
652024-10-03T20:36:11.564ZINFOcrucible-agent (worker): SMF ok!
662024-10-03T20:36:11.628ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62654 req_id = 8342cfaa-0224-43ef-bfb9-608599dfa5bf response_code = 200 uri = /crucible/0/regions