Max level shown:
1 [ Apr 3 05:11:52 Enabled. ]
2 [ Apr 3 05:11:52 Rereading configuration. ]
3 [ Apr 3 05:11:57 Rereading configuration. ]
4 [ Apr 3 05:12:01 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_be6f81b1-9138-4ee4-9eff-ed968536f83c/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-04-03T05:12:02.043ZINFOcrucible-agent: dataset: "oxp_be6f81b1-9138-4ee4-9eff-ed968536f83c/crucible"
72024-04-03T05:12:02.043ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82024-04-03T05:12:02.043ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-04-03T05:12:02.236ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
102024-04-03T05:12:20.467ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:52340
112024-04-03T05:12:20.497ZINFOcrucible-agent (datafile): region dce29779-ab1f-4f39-9795-73c8a4cc8cb3 state: Requested
122024-04-03T05:12:20.497ZINFOcrucible-agent (dropshot): request completed latency_us = 393 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52340 req_id = fb673fac-7251-4cda-b42b-ee31ef104a0a response_code = 200 uri = /crucible/0/regions
132024-04-03T05:12:20.498ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-04-03T05:12:20.508ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_be6f81b1-9138-4ee4-9eff-ed968536f83c/crucible/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
152024-04-03T05:12:20.508ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_be6f81b1-9138-4ee4-9eff-ed968536f83c/crucible/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
162024-04-03T05:12:20.597ZINFOcrucible-agent (worker): creating region Region { id: RegionId("dce29779-ab1f-4f39-9795-73c8a4cc8cb3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3" region = dce29779-ab1f-4f39-9795-73c8a4cc8cb3
172024-04-03T05:12:20.757ZINFOcrucible-agent (worker): region files created ok region = dce29779-ab1f-4f39-9795-73c8a4cc8cb3
182024-04-03T05:12:20.757ZINFOcrucible-agent (datafile): region dce29779-ab1f-4f39-9795-73c8a4cc8cb3 state: Requested -> Created
192024-04-03T05:12:20.757ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-04-03T05:12:20.757ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-dce29779-ab1f-4f39-9795-73c8a4cc8cb3
212024-04-03T05:12:20.773ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-dce29779-ab1f-4f39-9795-73c8a4cc8cb3
222024-04-03T05:12:20.793ZINFOcrucible-agent (worker): creating config property group
232024-04-03T05:12:20.808ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-dce29779-ab1f-4f39-9795-73c8a4cc8cb3
242024-04-03T05:12:20.809ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
252024-04-03T05:12:20.809ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-04-03T05:12:20.809ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
272024-04-03T05:12:20.809ZINFOcrucible-agent (worker): commit
282024-04-03T05:12:20.823ZINFOcrucible-agent (worker): ok!
292024-04-03T05:12:20.833ZINFOcrucible-agent (worker): SMF ok!
302024-04-03T05:12:20.873ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52340 req_id = 14ae742a-faa5-4fd7-ab17-7256cc859d3e response_code = 200 uri = /crucible/0/regions
312024-04-03T05:12:21.655ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:55687
322024-04-03T05:12:21.655ZINFOcrucible-agent (dropshot): request completed latency_us = 554 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55687 req_id = aaee6c9d-6d42-49f5-bd6c-d7972a21aa92 response_code = 200 uri = /crucible/0/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
332024-04-03T05:12:21.655ZINFOcrucible-agent (datafile): path is "/data/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3"
342024-04-03T05:12:21.665ZINFOcrucible-agent (datafile): dataset is oxp_be6f81b1-9138-4ee4-9eff-ed968536f83c/crucible/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
352024-04-03T05:12:21.673ZINFOcrucible-agent (datafile): region dce29779-ab1f-4f39-9795-73c8a4cc8cb3 state: Created -> Tombstoned
362024-04-03T05:12:21.673ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-04-03T05:12:21.673ZINFOcrucible-agent (dropshot): request completed latency_us = 18015 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:55687 req_id = 1abe3179-d2a7-4bf0-b03a-9449b64a7494 response_code = 204 uri = /crucible/0/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
382024-04-03T05:12:21.674ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55687 req_id = 8eefad0d-ec15-4ed6-9b45-e00e822ca50b response_code = 200 uri = /crucible/0/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
392024-04-03T05:12:21.674ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-dce29779-ab1f-4f39-9795-73c8a4cc8cb3 (instance states: (Some(Online), None))
402024-04-03T05:12:21.684ZINFOcrucible-agent (worker): SMF ok!
412024-04-03T05:12:21.693ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_be6f81b1-9138-4ee4-9eff-ed968536f83c/crucible/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3" region = dce29779-ab1f-4f39-9795-73c8a4cc8cb3
422024-04-03T05:12:21.748ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55687 req_id = 49018ff1-202c-4dae-a4cb-78de3ae55614 response_code = 200 uri = /crucible/0/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
432024-04-03T05:12:21.759ZINFOcrucible-agent (datafile): region dce29779-ab1f-4f39-9795-73c8a4cc8cb3 state: Tombstoned -> Destroyed
442024-04-03T05:12:21.894ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55687 req_id = cdf94d2c-6ed7-49d1-8683-15289f1cd037 response_code = 200 uri = /crucible/0/regions/dce29779-ab1f-4f39-9795-73c8a4cc8cb3
452024-04-03T05:12:22.967ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:41824
462024-04-03T05:12:22.997ZINFOcrucible-agent (datafile): region 5ea5e1c7-247e-4233-90e9-d8f4d31525c2 state: Requested
472024-04-03T05:12:22.998ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-04-03T05:12:22.998ZINFOcrucible-agent (dropshot): request completed latency_us = 1105 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41824 req_id = 65e12610-1f66-4dc7-8838-4e4caa54dfb2 response_code = 200 uri = /crucible/0/regions
492024-04-03T05:12:23.008ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_be6f81b1-9138-4ee4-9eff-ed968536f83c/crucible/regions/5ea5e1c7-247e-4233-90e9-d8f4d31525c2
502024-04-03T05:12:23.008ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_be6f81b1-9138-4ee4-9eff-ed968536f83c/crucible/regions/5ea5e1c7-247e-4233-90e9-d8f4d31525c2
512024-04-03T05:12:23.074ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5ea5e1c7-247e-4233-90e9-d8f4d31525c2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/5ea5e1c7-247e-4233-90e9-d8f4d31525c2" region = 5ea5e1c7-247e-4233-90e9-d8f4d31525c2
522024-04-03T05:12:23.158ZINFOcrucible-agent (worker): region files created ok region = 5ea5e1c7-247e-4233-90e9-d8f4d31525c2
532024-04-03T05:12:23.158ZINFOcrucible-agent (datafile): region 5ea5e1c7-247e-4233-90e9-d8f4d31525c2 state: Requested -> Created
542024-04-03T05:12:23.158ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-04-03T05:12:23.159ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5ea5e1c7-247e-4233-90e9-d8f4d31525c2
562024-04-03T05:12:23.164ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5ea5e1c7-247e-4233-90e9-d8f4d31525c2
572024-04-03T05:12:23.171ZINFOcrucible-agent (worker): creating config property group
582024-04-03T05:12:23.177ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5ea5e1c7-247e-4233-90e9-d8f4d31525c2
592024-04-03T05:12:23.177ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5ea5e1c7-247e-4233-90e9-d8f4d31525c2
602024-04-03T05:12:23.177ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-04-03T05:12:23.178ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
622024-04-03T05:12:23.178ZINFOcrucible-agent (worker): commit
632024-04-03T05:12:23.182ZINFOcrucible-agent (worker): ok!
642024-04-03T05:12:23.187ZINFOcrucible-agent (worker): SMF ok!
652024-04-03T05:12:23.364ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41824 req_id = c379e456-b1b7-4e4b-9a5a-34f83b2fbb44 response_code = 200 uri = /crucible/0/regions