Max level shown:
1 [ Aug 16 05:47:34 Enabled. ]
2 [ Aug 16 05:47:34 Rereading configuration. ]
3 [ Aug 16 05:47:35 Rereading configuration. ]
4 [ Aug 16 05:47:37 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_fad6b456-b1d5-4a78-ab60-3be928c7fd86/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-16T05:47:37.707ZINFOcrucible-agent: dataset: "oxp_fad6b456-b1d5-4a78-ab60-3be928c7fd86/crucible"
72024-08-16T05:47:37.708ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-08-16T05:47:37.708ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-16T05:47:37.721ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-16T05:47:37.836ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-08-16T05:47:57.704ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:59957
122024-08-16T05:47:57.706ZINFOcrucible-agent (datafile): region 392c5f25-4459-44f6-a93e-eb921ade6059 state: Requested
132024-08-16T05:47:57.707ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-08-16T05:47:57.707ZINFOcrucible-agent (dropshot): request completed latency_us = 1122 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59957 req_id = 2b8567ba-e744-474d-9800-fb98a96cca3a response_code = 200 uri = /crucible/0/regions
152024-08-16T05:47:57.716ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_fad6b456-b1d5-4a78-ab60-3be928c7fd86/crucible/regions/392c5f25-4459-44f6-a93e-eb921ade6059
162024-08-16T05:47:57.716ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_fad6b456-b1d5-4a78-ab60-3be928c7fd86/crucible/regions/392c5f25-4459-44f6-a93e-eb921ade6059
172024-08-16T05:47:57.766ZINFOcrucible-agent (worker): creating region Region { id: RegionId("392c5f25-4459-44f6-a93e-eb921ade6059"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/392c5f25-4459-44f6-a93e-eb921ade6059" region = 392c5f25-4459-44f6-a93e-eb921ade6059
182024-08-16T05:47:57.766ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "392c5f25-4459-44f6-a93e-eb921ade6059" "--data" "/data/regions/392c5f25-4459-44f6-a93e-eb921ade6059" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 392c5f25-4459-44f6-a93e-eb921ade6059
192024-08-16T05:47:57.876ZINFOcrucible-agent (worker): region files created ok region = 392c5f25-4459-44f6-a93e-eb921ade6059
202024-08-16T05:47:57.876ZINFOcrucible-agent (datafile): region 392c5f25-4459-44f6-a93e-eb921ade6059 state: Requested -> Created
212024-08-16T05:47:57.876ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-08-16T05:47:57.877ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-392c5f25-4459-44f6-a93e-eb921ade6059
232024-08-16T05:47:57.880ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-392c5f25-4459-44f6-a93e-eb921ade6059
242024-08-16T05:47:57.889ZINFOcrucible-agent (worker): creating config property group
252024-08-16T05:47:57.893ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-392c5f25-4459-44f6-a93e-eb921ade6059
262024-08-16T05:47:57.894ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/392c5f25-4459-44f6-a93e-eb921ade6059
272024-08-16T05:47:57.894ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-08-16T05:47:57.894ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
292024-08-16T05:47:57.894ZINFOcrucible-agent (worker): commit
302024-08-16T05:47:57.900ZINFOcrucible-agent (worker): ok!
312024-08-16T05:47:57.905ZINFOcrucible-agent (worker): SMF ok!
322024-08-16T05:47:57.938ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59957 req_id = 269187c1-43d9-44a7-b67e-530333fa73d5 response_code = 200 uri = /crucible/0/regions
332024-08-16T05:47:58.414ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59957 req_id = fb914d03-8022-49a8-9aa3-e75fe6fac629 response_code = 200 uri = /crucible/0/regions/392c5f25-4459-44f6-a93e-eb921ade6059
342024-08-16T05:47:58.417ZINFOcrucible-agent (datafile): path is "/data/regions/392c5f25-4459-44f6-a93e-eb921ade6059"
352024-08-16T05:47:58.427ZINFOcrucible-agent (datafile): dataset is oxp_fad6b456-b1d5-4a78-ab60-3be928c7fd86/crucible/regions/392c5f25-4459-44f6-a93e-eb921ade6059
362024-08-16T05:47:58.436ZINFOcrucible-agent (datafile): region 392c5f25-4459-44f6-a93e-eb921ade6059 state: Created -> Tombstoned
372024-08-16T05:47:58.436ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-08-16T05:47:58.436ZINFOcrucible-agent (dropshot): request completed latency_us = 19530 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:59957 req_id = 9ecfb4c9-3e97-47b8-b632-cb17c464d1f0 response_code = 204 uri = /crucible/0/regions/392c5f25-4459-44f6-a93e-eb921ade6059
392024-08-16T05:47:58.437ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-392c5f25-4459-44f6-a93e-eb921ade6059 (instance states: (Some(Online), None))
402024-08-16T05:47:58.439ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59957 req_id = 4eb8561a-8242-449b-84c9-9cfb0e965258 response_code = 200 uri = /crucible/0/regions/392c5f25-4459-44f6-a93e-eb921ade6059
412024-08-16T05:47:58.441ZINFOcrucible-agent (worker): SMF ok!
422024-08-16T05:47:58.451ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_fad6b456-b1d5-4a78-ab60-3be928c7fd86/crucible/regions/392c5f25-4459-44f6-a93e-eb921ade6059" region = 392c5f25-4459-44f6-a93e-eb921ade6059
432024-08-16T05:47:58.508ZINFOcrucible-agent (datafile): region 392c5f25-4459-44f6-a93e-eb921ade6059 state: Tombstoned -> Destroyed
442024-08-16T05:47:58.577ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59957 req_id = 4ba7b070-d8f6-43d4-b8b8-0eeea44a58af response_code = 200 uri = /crucible/0/regions/392c5f25-4459-44f6-a93e-eb921ade6059
452024-08-16T05:54:08.100ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:39599
462024-08-16T05:54:08.101ZINFOcrucible-agent (datafile): region 2ed17d75-36e7-4a44-9469-1bb2edc1d823 state: Requested
472024-08-16T05:54:08.101ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-08-16T05:54:08.101ZINFOcrucible-agent (dropshot): request completed latency_us = 632 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39599 req_id = 69b801a7-00ca-4c46-8099-9fb3a8c89474 response_code = 200 uri = /crucible/0/regions
492024-08-16T05:54:08.112ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fad6b456-b1d5-4a78-ab60-3be928c7fd86/crucible/regions/2ed17d75-36e7-4a44-9469-1bb2edc1d823
502024-08-16T05:54:08.112ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fad6b456-b1d5-4a78-ab60-3be928c7fd86/crucible/regions/2ed17d75-36e7-4a44-9469-1bb2edc1d823
512024-08-16T05:54:08.172ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2ed17d75-36e7-4a44-9469-1bb2edc1d823"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2ed17d75-36e7-4a44-9469-1bb2edc1d823" region = 2ed17d75-36e7-4a44-9469-1bb2edc1d823
522024-08-16T05:54:08.174ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2ed17d75-36e7-4a44-9469-1bb2edc1d823" "--data" "/data/regions/2ed17d75-36e7-4a44-9469-1bb2edc1d823" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2ed17d75-36e7-4a44-9469-1bb2edc1d823
532024-08-16T05:54:08.335ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39599 req_id = e60d0199-6a55-4e99-937f-1de2591e2938 response_code = 200 uri = /crucible/0/regions
542024-08-16T05:54:08.465ZINFOcrucible-agent (worker): region files created ok region = 2ed17d75-36e7-4a44-9469-1bb2edc1d823
552024-08-16T05:54:08.465ZINFOcrucible-agent (datafile): region 2ed17d75-36e7-4a44-9469-1bb2edc1d823 state: Requested -> Created
562024-08-16T05:54:08.465ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-08-16T05:54:08.466ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2ed17d75-36e7-4a44-9469-1bb2edc1d823
582024-08-16T05:54:08.472ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2ed17d75-36e7-4a44-9469-1bb2edc1d823
592024-08-16T05:54:08.481ZINFOcrucible-agent (worker): creating config property group
602024-08-16T05:54:08.483ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2ed17d75-36e7-4a44-9469-1bb2edc1d823
612024-08-16T05:54:08.484ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2ed17d75-36e7-4a44-9469-1bb2edc1d823
622024-08-16T05:54:08.484ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-08-16T05:54:08.484ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
642024-08-16T05:54:08.484ZINFOcrucible-agent (worker): commit
652024-08-16T05:54:08.488ZINFOcrucible-agent (worker): ok!
662024-08-16T05:54:08.492ZINFOcrucible-agent (worker): SMF ok!
672024-08-16T05:54:08.936ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39599 req_id = 443edfd5-dcbc-485e-9e0a-5117e979b294 response_code = 200 uri = /crucible/0/regions