Max level shown:
1 [ Dec 12 22:34:12 Enabled. ]
2 [ Dec 12 22:34:12 Rereading configuration. ]
3 [ Dec 12 22:34:15 Rereading configuration. ]
4 [ Dec 12 22:34:18 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-12T22:34:18.943ZINFOcrucible-agent: dataset: "oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible"
72024-12-12T22:34:18.947ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-12-12T22:34:18.947ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-12T22:34:18.964ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-12T22:34:19.068ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-12-12T22:34:42.389ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:45582
122024-12-12T22:34:42.406ZINFOcrucible-agent (datafile): region 88f141ca-cc1e-4592-8bdd-21bac9c7f477 state: Requested
132024-12-12T22:34:42.408ZINFOcrucible-agent (dropshot): request completed latency_us = 4796 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:45582 req_id = 29bfa9be-e9c9-425c-9b8a-42a0ae676e0d response_code = 200 uri = /crucible/0/regions
142024-12-12T22:34:42.408ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-12-12T22:34:42.417ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477
162024-12-12T22:34:42.417ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477
172024-12-12T22:34:42.492ZINFOcrucible-agent (worker): creating region Region { id: RegionId("88f141ca-cc1e-4592-8bdd-21bac9c7f477"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477" region = 88f141ca-cc1e-4592-8bdd-21bac9c7f477
182024-12-12T22:34:42.494ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "88f141ca-cc1e-4592-8bdd-21bac9c7f477" "--data" "/data/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 88f141ca-cc1e-4592-8bdd-21bac9c7f477
192024-12-12T22:34:42.609ZINFOcrucible-agent (worker): region files created ok region = 88f141ca-cc1e-4592-8bdd-21bac9c7f477
202024-12-12T22:34:42.609ZINFOcrucible-agent (datafile): region 88f141ca-cc1e-4592-8bdd-21bac9c7f477 state: Requested -> Created
212024-12-12T22:34:42.610ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-12-12T22:34:42.610ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-88f141ca-cc1e-4592-8bdd-21bac9c7f477
232024-12-12T22:34:42.613ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-88f141ca-cc1e-4592-8bdd-21bac9c7f477
242024-12-12T22:34:42.622ZINFOcrucible-agent (worker): creating config property group
252024-12-12T22:34:42.626ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-88f141ca-cc1e-4592-8bdd-21bac9c7f477
262024-12-12T22:34:42.627ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477
272024-12-12T22:34:42.627ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-12-12T22:34:42.627ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
292024-12-12T22:34:42.627ZINFOcrucible-agent (worker): commit
302024-12-12T22:34:42.632ZINFOcrucible-agent (worker): ok!
312024-12-12T22:34:42.637ZINFOcrucible-agent (worker): SMF ok!
322024-12-12T22:34:42.675ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:45582 req_id = 73feb212-9c96-4492-bd0f-0d668f6a000d response_code = 200 uri = /crucible/0/regions
332024-12-12T22:34:43.456ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:45582 req_id = 3751d99b-244d-4d79-b3fd-b2f6c4bdd7a3 response_code = 200 uri = /crucible/0/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477
342024-12-12T22:34:43.460ZINFOcrucible-agent (datafile): path is "/data/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477"
352024-12-12T22:34:43.471ZINFOcrucible-agent (datafile): dataset is oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477
362024-12-12T22:34:43.481ZINFOcrucible-agent (datafile): region 88f141ca-cc1e-4592-8bdd-21bac9c7f477 state: Created -> Tombstoned
372024-12-12T22:34:43.482ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-12-12T22:34:43.482ZINFOcrucible-agent (dropshot): request completed latency_us = 21575 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:45582 req_id = 2f86e623-70d2-4b61-9846-0299a7c8d893 response_code = 204 uri = /crucible/0/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477
392024-12-12T22:34:43.484ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:45582 req_id = b1902232-97c7-43d9-974a-4d607daf3745 response_code = 200 uri = /crucible/0/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477
402024-12-12T22:34:43.485ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-88f141ca-cc1e-4592-8bdd-21bac9c7f477 (instance states: (Some(Online), None))
412024-12-12T22:34:43.489ZINFOcrucible-agent (worker): SMF ok!
422024-12-12T22:34:43.500ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477" region = 88f141ca-cc1e-4592-8bdd-21bac9c7f477
432024-12-12T22:34:43.561ZINFOcrucible-agent (datafile): region 88f141ca-cc1e-4592-8bdd-21bac9c7f477 state: Tombstoned -> Destroyed
442024-12-12T22:34:43.609ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:45582 req_id = d0b93686-fe40-420a-85f5-a0f0adcf719c response_code = 200 uri = /crucible/0/regions/88f141ca-cc1e-4592-8bdd-21bac9c7f477
452024-12-12T22:35:27.445ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:59513
462024-12-12T22:35:27.445ZINFOcrucible-agent (datafile): region 93074bf6-0e13-44ef-a787-a3578e290067 state: Requested
472024-12-12T22:35:27.445ZINFOcrucible-agent (dropshot): request completed latency_us = 215 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59513 req_id = baa90258-fcef-4987-9501-c9bb7669f52e response_code = 200 uri = /crucible/0/regions
482024-12-12T22:35:27.445ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-12-12T22:35:27.455ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible/regions/93074bf6-0e13-44ef-a787-a3578e290067
502024-12-12T22:35:27.455ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible/regions/93074bf6-0e13-44ef-a787-a3578e290067
512024-12-12T22:35:27.506ZINFOcrucible-agent (worker): creating region Region { id: RegionId("93074bf6-0e13-44ef-a787-a3578e290067"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/93074bf6-0e13-44ef-a787-a3578e290067" region = 93074bf6-0e13-44ef-a787-a3578e290067
522024-12-12T22:35:27.506ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "93074bf6-0e13-44ef-a787-a3578e290067" "--data" "/data/regions/93074bf6-0e13-44ef-a787-a3578e290067" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 93074bf6-0e13-44ef-a787-a3578e290067
532024-12-12T22:35:27.581ZINFOcrucible-agent (worker): region files created ok region = 93074bf6-0e13-44ef-a787-a3578e290067
542024-12-12T22:35:27.581ZINFOcrucible-agent (datafile): region 93074bf6-0e13-44ef-a787-a3578e290067 state: Requested -> Created
552024-12-12T22:35:27.581ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-12-12T22:35:27.582ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-93074bf6-0e13-44ef-a787-a3578e290067
572024-12-12T22:35:27.585ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-93074bf6-0e13-44ef-a787-a3578e290067
582024-12-12T22:35:27.592ZINFOcrucible-agent (worker): creating config property group
592024-12-12T22:35:27.596ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-93074bf6-0e13-44ef-a787-a3578e290067
602024-12-12T22:35:27.596ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/93074bf6-0e13-44ef-a787-a3578e290067
612024-12-12T22:35:27.596ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-12-12T22:35:27.596ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
632024-12-12T22:35:27.596ZINFOcrucible-agent (worker): commit
642024-12-12T22:35:27.600ZINFOcrucible-agent (worker): ok!
652024-12-12T22:35:27.606ZINFOcrucible-agent (worker): SMF ok!
662024-12-12T22:35:27.651ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59513 req_id = 6c1a02ed-6b3f-44d2-881e-28653450cba0 response_code = 200 uri = /crucible/0/regions