Max level shown:
1 [ Dec 7 00:47:49 Enabled. ]
2 [ Dec 7 00:47:49 Rereading configuration. ]
3 [ Dec 7 00:47:54 Rereading configuration. ]
4 [ Dec 7 00:48:04 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-07T00:48:04.065ZINFOcrucible-agent: dataset: "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible"
72024-12-07T00:48:04.067ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82024-12-07T00:48:04.067ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-07T00:48:04.082ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-07T00:48:04.251ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
112024-12-07T00:48:52.825ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:55862
122024-12-07T00:48:52.868ZINFOcrucible-agent (datafile): region e8981efb-e709-48c7-b890-aa2b84e4fff2 state: Requested
132024-12-07T00:48:52.873ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-12-07T00:48:52.877ZINFOcrucible-agent (dropshot): request completed latency_us = 15515 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55862 req_id = 9ef66913-e135-45c4-869a-0a8a22fe219d response_code = 200 uri = /crucible/0/regions
152024-12-07T00:48:52.885ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2
162024-12-07T00:48:52.885ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2
172024-12-07T00:48:52.979ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e8981efb-e709-48c7-b890-aa2b84e4fff2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2" region = e8981efb-e709-48c7-b890-aa2b84e4fff2
182024-12-07T00:48:52.982ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e8981efb-e709-48c7-b890-aa2b84e4fff2" "--data" "/data/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = e8981efb-e709-48c7-b890-aa2b84e4fff2
192024-12-07T00:48:53.061ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55862 req_id = ae498741-6f06-44ec-85bd-0b7f884c69cf response_code = 200 uri = /crucible/0/regions
202024-12-07T00:48:53.260ZINFOcrucible-agent (worker): region files created ok region = e8981efb-e709-48c7-b890-aa2b84e4fff2
212024-12-07T00:48:53.260ZINFOcrucible-agent (datafile): region e8981efb-e709-48c7-b890-aa2b84e4fff2 state: Requested -> Created
222024-12-07T00:48:53.260ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-12-07T00:48:53.260ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e8981efb-e709-48c7-b890-aa2b84e4fff2
242024-12-07T00:48:53.268ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e8981efb-e709-48c7-b890-aa2b84e4fff2
252024-12-07T00:48:53.285ZINFOcrucible-agent (worker): creating config property group
262024-12-07T00:48:53.290ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e8981efb-e709-48c7-b890-aa2b84e4fff2
272024-12-07T00:48:53.291ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2
282024-12-07T00:48:53.291ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-12-07T00:48:53.291ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
302024-12-07T00:48:53.291ZINFOcrucible-agent (worker): commit
312024-12-07T00:48:53.296ZINFOcrucible-agent (worker): ok!
322024-12-07T00:48:53.301ZINFOcrucible-agent (worker): SMF ok!
332024-12-07T00:48:53.680ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55862 req_id = 2bbe9ac1-c975-4a98-a5fb-67a58f02c073 response_code = 200 uri = /crucible/0/regions
342024-12-07T00:48:54.532ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55862 req_id = 9000faa1-6d33-47ed-9b66-59b737a8a258 response_code = 200 uri = /crucible/0/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2
352024-12-07T00:48:54.535ZINFOcrucible-agent (datafile): path is "/data/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2"
362024-12-07T00:48:54.546ZINFOcrucible-agent (datafile): dataset is oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2
372024-12-07T00:48:54.555ZINFOcrucible-agent (datafile): region e8981efb-e709-48c7-b890-aa2b84e4fff2 state: Created -> Tombstoned
382024-12-07T00:48:54.556ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-12-07T00:48:54.556ZINFOcrucible-agent (dropshot): request completed latency_us = 20744 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:55862 req_id = 9340f036-7e54-491d-a987-3eddfcc025db response_code = 204 uri = /crucible/0/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2
402024-12-07T00:48:54.559ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e8981efb-e709-48c7-b890-aa2b84e4fff2 (instance states: (Some(Online), None))
412024-12-07T00:48:54.559ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55862 req_id = a1f47064-d3fa-4056-a280-1b27404efc02 response_code = 200 uri = /crucible/0/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2
422024-12-07T00:48:54.565ZINFOcrucible-agent (worker): SMF ok!
432024-12-07T00:48:54.575ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2" region = e8981efb-e709-48c7-b890-aa2b84e4fff2
442024-12-07T00:48:54.641ZINFOcrucible-agent (datafile): region e8981efb-e709-48c7-b890-aa2b84e4fff2 state: Tombstoned -> Destroyed
452024-12-07T00:48:54.714ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55862 req_id = fab6c908-bea1-42e4-bdbd-04fb5fde5411 response_code = 200 uri = /crucible/0/regions/e8981efb-e709-48c7-b890-aa2b84e4fff2
462024-12-07T00:59:25.644ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:46836
472024-12-07T00:59:25.644ZINFOcrucible-agent (datafile): region efb081a4-98c3-44f6-859f-8fe84aa39173 state: Requested
482024-12-07T00:59:25.645ZINFOcrucible-agent (dropshot): request completed latency_us = 755 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46836 req_id = 971f2549-a717-4f3a-a82f-87af10e8697f response_code = 200 uri = /crucible/0/regions
492024-12-07T00:59:25.645ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502024-12-07T00:59:25.656ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible/regions/efb081a4-98c3-44f6-859f-8fe84aa39173
512024-12-07T00:59:25.656ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible/regions/efb081a4-98c3-44f6-859f-8fe84aa39173
522024-12-07T00:59:25.710ZINFOcrucible-agent (worker): creating region Region { id: RegionId("efb081a4-98c3-44f6-859f-8fe84aa39173"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/efb081a4-98c3-44f6-859f-8fe84aa39173" region = efb081a4-98c3-44f6-859f-8fe84aa39173
532024-12-07T00:59:25.712ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "efb081a4-98c3-44f6-859f-8fe84aa39173" "--data" "/data/regions/efb081a4-98c3-44f6-859f-8fe84aa39173" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = efb081a4-98c3-44f6-859f-8fe84aa39173
542024-12-07T00:59:25.782ZINFOcrucible-agent (worker): region files created ok region = efb081a4-98c3-44f6-859f-8fe84aa39173
552024-12-07T00:59:25.782ZINFOcrucible-agent (datafile): region efb081a4-98c3-44f6-859f-8fe84aa39173 state: Requested -> Created
562024-12-07T00:59:25.782ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-12-07T00:59:25.784ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-efb081a4-98c3-44f6-859f-8fe84aa39173
582024-12-07T00:59:25.789ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-efb081a4-98c3-44f6-859f-8fe84aa39173
592024-12-07T00:59:25.801ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46836 req_id = 65db79e8-d15d-458e-b507-ab3317b852ac response_code = 200 uri = /crucible/0/regions
602024-12-07T00:59:25.802ZINFOcrucible-agent (worker): creating config property group
612024-12-07T00:59:25.805ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-efb081a4-98c3-44f6-859f-8fe84aa39173
622024-12-07T00:59:25.806ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/efb081a4-98c3-44f6-859f-8fe84aa39173
632024-12-07T00:59:25.806ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
642024-12-07T00:59:25.806ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
652024-12-07T00:59:25.806ZINFOcrucible-agent (worker): commit
662024-12-07T00:59:25.811ZINFOcrucible-agent (worker): ok!
672024-12-07T00:59:25.819ZINFOcrucible-agent (worker): SMF ok!