Max level shown:
1 [ Aug 16 05:47:28 Enabled. ]
2 [ Aug 16 05:47:28 Rereading configuration. ]
3 [ Aug 16 05:47:29 Rereading configuration. ]
4 [ Aug 16 05:47:32 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_80ee3a20-cd44-463d-a940-182337f43ebb/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-16T05:47:32.608ZINFOcrucible-agent: dataset: "oxp_80ee3a20-cd44-463d-a940-182337f43ebb/crucible"
72024-08-16T05:47:32.609ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82024-08-16T05:47:32.609ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-16T05:47:32.627ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-16T05:47:32.782ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
112024-08-16T05:47:57.704ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:49472
122024-08-16T05:47:57.725ZINFOcrucible-agent (datafile): region 41752536-95cf-4d38-8375-10a40f338055 state: Requested
132024-08-16T05:47:57.730ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-08-16T05:47:57.734ZINFOcrucible-agent (dropshot): request completed latency_us = 14290 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49472 req_id = d7df89c9-5e54-4666-a066-38184b6db86b response_code = 200 uri = /crucible/0/regions
152024-08-16T05:47:57.740ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_80ee3a20-cd44-463d-a940-182337f43ebb/crucible/regions/41752536-95cf-4d38-8375-10a40f338055
162024-08-16T05:47:57.740ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_80ee3a20-cd44-463d-a940-182337f43ebb/crucible/regions/41752536-95cf-4d38-8375-10a40f338055
172024-08-16T05:47:57.812ZINFOcrucible-agent (worker): creating region Region { id: RegionId("41752536-95cf-4d38-8375-10a40f338055"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/41752536-95cf-4d38-8375-10a40f338055" region = 41752536-95cf-4d38-8375-10a40f338055
182024-08-16T05:47:57.814ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "41752536-95cf-4d38-8375-10a40f338055" "--data" "/data/regions/41752536-95cf-4d38-8375-10a40f338055" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 41752536-95cf-4d38-8375-10a40f338055
192024-08-16T05:47:57.934ZINFOcrucible-agent (worker): region files created ok region = 41752536-95cf-4d38-8375-10a40f338055
202024-08-16T05:47:57.934ZINFOcrucible-agent (datafile): region 41752536-95cf-4d38-8375-10a40f338055 state: Requested -> Created
212024-08-16T05:47:57.934ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-08-16T05:47:57.934ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-41752536-95cf-4d38-8375-10a40f338055
232024-08-16T05:47:57.938ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-41752536-95cf-4d38-8375-10a40f338055
242024-08-16T05:47:57.959ZINFOcrucible-agent (worker): creating config property group
252024-08-16T05:47:57.962ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-41752536-95cf-4d38-8375-10a40f338055
262024-08-16T05:47:57.967ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/41752536-95cf-4d38-8375-10a40f338055
272024-08-16T05:47:57.967ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-08-16T05:47:57.967ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
292024-08-16T05:47:57.967ZINFOcrucible-agent (worker): commit
302024-08-16T05:47:57.972ZINFOcrucible-agent (worker): ok!
312024-08-16T05:47:57.977ZINFOcrucible-agent (worker): SMF ok!
322024-08-16T05:47:58.072ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49472 req_id = c3f59ffb-1f02-4c08-969e-00db0708e384 response_code = 200 uri = /crucible/0/regions
332024-08-16T05:47:58.758ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:49472 req_id = cdb2cd80-8976-4d83-aa06-53b925a60a30 response_code = 200 uri = /crucible/0/regions/41752536-95cf-4d38-8375-10a40f338055
342024-08-16T05:47:58.760ZINFOcrucible-agent (datafile): path is "/data/regions/41752536-95cf-4d38-8375-10a40f338055"
352024-08-16T05:47:58.769ZINFOcrucible-agent (datafile): dataset is oxp_80ee3a20-cd44-463d-a940-182337f43ebb/crucible/regions/41752536-95cf-4d38-8375-10a40f338055
362024-08-16T05:47:58.777ZINFOcrucible-agent (datafile): region 41752536-95cf-4d38-8375-10a40f338055 state: Created -> Tombstoned
372024-08-16T05:47:58.777ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-08-16T05:47:58.777ZINFOcrucible-agent (dropshot): request completed latency_us = 16809 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:49472 req_id = fbd5569d-520e-4d99-9b3c-80ce6d8c02c9 response_code = 204 uri = /crucible/0/regions/41752536-95cf-4d38-8375-10a40f338055
392024-08-16T05:47:58.778ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-41752536-95cf-4d38-8375-10a40f338055 (instance states: (Some(Online), None))
402024-08-16T05:47:58.780ZINFOcrucible-agent (dropshot): request completed latency_us = 544 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:49472 req_id = 49b5c8d6-9a1f-4eb5-af18-299bfa8c17cb response_code = 200 uri = /crucible/0/regions/41752536-95cf-4d38-8375-10a40f338055
412024-08-16T05:47:58.783ZINFOcrucible-agent (worker): SMF ok!
422024-08-16T05:47:58.792ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_80ee3a20-cd44-463d-a940-182337f43ebb/crucible/regions/41752536-95cf-4d38-8375-10a40f338055" region = 41752536-95cf-4d38-8375-10a40f338055
432024-08-16T05:47:58.860ZINFOcrucible-agent (datafile): region 41752536-95cf-4d38-8375-10a40f338055 state: Tombstoned -> Destroyed
442024-08-16T05:47:58.874ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:49472 req_id = a1e26f06-a3e9-43db-88db-45fa73452a4b response_code = 200 uri = /crucible/0/regions/41752536-95cf-4d38-8375-10a40f338055
452024-08-16T05:54:08.101ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:60588
462024-08-16T05:54:08.101ZINFOcrucible-agent (datafile): region e163f2d4-2b46-4f25-99bd-d06fdd1a07c2 state: Requested
472024-08-16T05:54:08.102ZINFOcrucible-agent (dropshot): request completed latency_us = 711 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60588 req_id = 07a5f80d-4b8e-441d-babb-5c91a50dbd03 response_code = 200 uri = /crucible/0/regions
482024-08-16T05:54:08.102ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-08-16T05:54:08.115ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_80ee3a20-cd44-463d-a940-182337f43ebb/crucible/regions/e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
502024-08-16T05:54:08.115ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_80ee3a20-cd44-463d-a940-182337f43ebb/crucible/regions/e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
512024-08-16T05:54:08.174ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e163f2d4-2b46-4f25-99bd-d06fdd1a07c2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e163f2d4-2b46-4f25-99bd-d06fdd1a07c2" region = e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
522024-08-16T05:54:08.176ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e163f2d4-2b46-4f25-99bd-d06fdd1a07c2" "--data" "/data/regions/e163f2d4-2b46-4f25-99bd-d06fdd1a07c2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
532024-08-16T05:54:08.368ZINFOcrucible-agent (worker): region files created ok region = e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
542024-08-16T05:54:08.368ZINFOcrucible-agent (datafile): region e163f2d4-2b46-4f25-99bd-d06fdd1a07c2 state: Requested -> Created
552024-08-16T05:54:08.368ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-08-16T05:54:08.370ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
572024-08-16T05:54:08.376ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
582024-08-16T05:54:08.376ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60588 req_id = 46d44b87-00a6-42d4-b3e8-244bcfcb4f52 response_code = 200 uri = /crucible/0/regions
592024-08-16T05:54:08.387ZINFOcrucible-agent (worker): creating config property group
602024-08-16T05:54:08.390ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
612024-08-16T05:54:08.391ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e163f2d4-2b46-4f25-99bd-d06fdd1a07c2
622024-08-16T05:54:08.391ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-08-16T05:54:08.391ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
642024-08-16T05:54:08.391ZINFOcrucible-agent (worker): commit
652024-08-16T05:54:08.395ZINFOcrucible-agent (worker): ok!
662024-08-16T05:54:08.399ZINFOcrucible-agent (worker): SMF ok!