Max level shown:
12024-08-06T04:00:49.213ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:41820
22024-08-06T04:00:49.236ZINFOcrucible-agent (datafile): region b60c3c04-df98-414e-8870-5447f0ace962 state: Requested
32024-08-06T04:00:49.241ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42024-08-06T04:00:49.245ZINFOcrucible-agent (dropshot): request completed latency_us = 15059 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41820 req_id = f8dd234b-532b-43b1-8496-e625fe36d9e0 response_code = 200 uri = /crucible/0/regions
52024-08-06T04:00:49.255ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_8833a1dd-6aa9-4d07-b5ac-5b88962239da/crucible/regions/b60c3c04-df98-414e-8870-5447f0ace962
62024-08-06T04:00:49.255ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_8833a1dd-6aa9-4d07-b5ac-5b88962239da/crucible/regions/b60c3c04-df98-414e-8870-5447f0ace962
72024-08-06T04:00:49.328ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b60c3c04-df98-414e-8870-5447f0ace962"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b60c3c04-df98-414e-8870-5447f0ace962" region = b60c3c04-df98-414e-8870-5447f0ace962
82024-08-06T04:00:49.330ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b60c3c04-df98-414e-8870-5447f0ace962" "--data" "/data/regions/b60c3c04-df98-414e-8870-5447f0ace962" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = b60c3c04-df98-414e-8870-5447f0ace962
92024-08-06T04:00:49.443ZINFOcrucible-agent (worker): region files created ok region = b60c3c04-df98-414e-8870-5447f0ace962
102024-08-06T04:00:49.443ZINFOcrucible-agent (datafile): region b60c3c04-df98-414e-8870-5447f0ace962 state: Requested -> Created
112024-08-06T04:00:49.444ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-08-06T04:00:49.444ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b60c3c04-df98-414e-8870-5447f0ace962
132024-08-06T04:00:49.449ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b60c3c04-df98-414e-8870-5447f0ace962
142024-08-06T04:00:49.470ZINFOcrucible-agent (worker): creating config property group
152024-08-06T04:00:49.474ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b60c3c04-df98-414e-8870-5447f0ace962
162024-08-06T04:00:49.484ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b60c3c04-df98-414e-8870-5447f0ace962
172024-08-06T04:00:49.487ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-08-06T04:00:49.487ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192024-08-06T04:00:49.487ZINFOcrucible-agent (worker): commit
202024-08-06T04:00:49.491ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41820 req_id = 11e9e9f3-2bca-4a8e-9879-8df25e15e9b3 response_code = 200 uri = /crucible/0/regions
212024-08-06T04:00:49.492ZINFOcrucible-agent (worker): ok!
222024-08-06T04:00:49.496ZINFOcrucible-agent (worker): SMF ok!
232024-08-06T04:00:49.695ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41820 req_id = ebc4ceb4-1eab-4b72-90d5-4ed5f2409f1b response_code = 200 uri = /crucible/0/regions/b60c3c04-df98-414e-8870-5447f0ace962
242024-08-06T04:00:49.697ZINFOcrucible-agent (datafile): path is "/data/regions/b60c3c04-df98-414e-8870-5447f0ace962"
252024-08-06T04:00:49.706ZINFOcrucible-agent (datafile): dataset is oxp_8833a1dd-6aa9-4d07-b5ac-5b88962239da/crucible/regions/b60c3c04-df98-414e-8870-5447f0ace962
262024-08-06T04:00:49.715ZINFOcrucible-agent (datafile): region b60c3c04-df98-414e-8870-5447f0ace962 state: Created -> Tombstoned
272024-08-06T04:00:49.716ZINFOcrucible-agent (worker): applying SMF actions before removal...
282024-08-06T04:00:49.716ZINFOcrucible-agent (dropshot): request completed latency_us = 18870 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:41820 req_id = b7aa04d9-27d9-4717-abbd-9a904070d5fb response_code = 204 uri = /crucible/0/regions/b60c3c04-df98-414e-8870-5447f0ace962
292024-08-06T04:00:49.717ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b60c3c04-df98-414e-8870-5447f0ace962 (instance states: (Some(Online), None))
302024-08-06T04:00:49.718ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41820 req_id = a33b5806-de93-4830-9b74-feb7389fd5ea response_code = 200 uri = /crucible/0/regions/b60c3c04-df98-414e-8870-5447f0ace962
312024-08-06T04:00:49.722ZINFOcrucible-agent (worker): SMF ok!
322024-08-06T04:00:49.731ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8833a1dd-6aa9-4d07-b5ac-5b88962239da/crucible/regions/b60c3c04-df98-414e-8870-5447f0ace962" region = b60c3c04-df98-414e-8870-5447f0ace962
332024-08-06T04:00:49.795ZINFOcrucible-agent (datafile): region b60c3c04-df98-414e-8870-5447f0ace962 state: Tombstoned -> Destroyed
342024-08-06T04:00:49.843ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41820 req_id = 94f82930-66a7-41ff-a272-9cfdff6b8555 response_code = 200 uri = /crucible/0/regions/b60c3c04-df98-414e-8870-5447f0ace962
352024-08-06T04:06:34.593ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:59556
362024-08-06T04:06:34.593ZINFOcrucible-agent (datafile): region 55859ba8-ddef-4110-9a06-22452ef45850 state: Requested
372024-08-06T04:06:34.594ZINFOcrucible-agent (dropshot): request completed latency_us = 652 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59556 req_id = 0315645d-4d57-4ff1-9aea-b69e59641fb9 response_code = 200 uri = /crucible/0/regions
382024-08-06T04:06:34.594ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
392024-08-06T04:06:34.606ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8833a1dd-6aa9-4d07-b5ac-5b88962239da/crucible/regions/55859ba8-ddef-4110-9a06-22452ef45850
402024-08-06T04:06:34.606ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8833a1dd-6aa9-4d07-b5ac-5b88962239da/crucible/regions/55859ba8-ddef-4110-9a06-22452ef45850
412024-08-06T04:06:34.670ZINFOcrucible-agent (worker): creating region Region { id: RegionId("55859ba8-ddef-4110-9a06-22452ef45850"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/55859ba8-ddef-4110-9a06-22452ef45850" region = 55859ba8-ddef-4110-9a06-22452ef45850
422024-08-06T04:06:34.670ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "55859ba8-ddef-4110-9a06-22452ef45850" "--data" "/data/regions/55859ba8-ddef-4110-9a06-22452ef45850" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 55859ba8-ddef-4110-9a06-22452ef45850
432024-08-06T04:06:34.925ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59556 req_id = 1192db8c-d34e-4906-aac5-27b2322aa603 response_code = 200 uri = /crucible/0/regions
442024-08-06T04:06:34.968ZINFOcrucible-agent (worker): region files created ok region = 55859ba8-ddef-4110-9a06-22452ef45850
452024-08-06T04:06:34.968ZINFOcrucible-agent (datafile): region 55859ba8-ddef-4110-9a06-22452ef45850 state: Requested -> Created
462024-08-06T04:06:34.968ZINFOcrucible-agent (worker): applying SMF actions post create...
472024-08-06T04:06:34.970ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-55859ba8-ddef-4110-9a06-22452ef45850
482024-08-06T04:06:34.974ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-55859ba8-ddef-4110-9a06-22452ef45850
492024-08-06T04:06:34.986ZINFOcrucible-agent (worker): creating config property group
502024-08-06T04:06:34.990ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-55859ba8-ddef-4110-9a06-22452ef45850
512024-08-06T04:06:34.990ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/55859ba8-ddef-4110-9a06-22452ef45850
522024-08-06T04:06:34.990ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532024-08-06T04:06:34.990ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
542024-08-06T04:06:34.990ZINFOcrucible-agent (worker): commit
552024-08-06T04:06:34.994ZINFOcrucible-agent (worker): ok!
562024-08-06T04:06:34.999ZINFOcrucible-agent (worker): SMF ok!
572024-08-06T04:06:35.300ZINFOcrucible-agent (dropshot): request completed latency_us = 624 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59556 req_id = 58b8c153-7604-4743-993a-af27f876e8d9 response_code = 200 uri = /crucible/0/regions
582024-08-06T04:06:59.061ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59556 req_id = 69bba67e-e1da-4b84-85fc-c280f7cda0d2 response_code = 200 uri = /crucible/0/regions/55859ba8-ddef-4110-9a06-22452ef45850
592024-08-06T04:06:59.064ZINFOcrucible-agent (datafile): path is "/data/regions/55859ba8-ddef-4110-9a06-22452ef45850"
602024-08-06T04:06:59.076ZINFOcrucible-agent (datafile): dataset is oxp_8833a1dd-6aa9-4d07-b5ac-5b88962239da/crucible/regions/55859ba8-ddef-4110-9a06-22452ef45850
612024-08-06T04:06:59.085ZINFOcrucible-agent (datafile): region 55859ba8-ddef-4110-9a06-22452ef45850 state: Created -> Tombstoned
622024-08-06T04:06:59.085ZINFOcrucible-agent (worker): applying SMF actions before removal...
632024-08-06T04:06:59.085ZINFOcrucible-agent (dropshot): request completed latency_us = 21430 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:59556 req_id = cef8d496-1c5e-4e8f-b118-d669cba00872 response_code = 204 uri = /crucible/0/regions/55859ba8-ddef-4110-9a06-22452ef45850
642024-08-06T04:06:59.087ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-55859ba8-ddef-4110-9a06-22452ef45850 (instance states: (Some(Online), None))
652024-08-06T04:06:59.088ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59556 req_id = 8f30b445-b94f-4334-864e-26583d4225ed response_code = 200 uri = /crucible/0/regions/55859ba8-ddef-4110-9a06-22452ef45850
662024-08-06T04:06:59.091ZINFOcrucible-agent (worker): SMF ok!
672024-08-06T04:06:59.100ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8833a1dd-6aa9-4d07-b5ac-5b88962239da/crucible/regions/55859ba8-ddef-4110-9a06-22452ef45850" region = 55859ba8-ddef-4110-9a06-22452ef45850
682024-08-06T04:06:59.152ZINFOcrucible-agent (datafile): region 55859ba8-ddef-4110-9a06-22452ef45850 state: Tombstoned -> Destroyed
692024-08-06T04:06:59.232ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59556 req_id = 87794f7c-4226-47d3-896f-29e919a5f110 response_code = 200 uri = /crucible/0/regions/55859ba8-ddef-4110-9a06-22452ef45850