Max level shown:
12024-02-12T21:15:45.469ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:61489
22024-02-12T21:15:45.544ZINFOcrucible-agent (datafile): region e9c3c514-bd63-4d03-b280-6f4306ceb53c state: Requested
32024-02-12T21:15:45.545ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42024-02-12T21:15:45.545ZINFOcrucible-agent (dropshot): request completed latency_us = 9607 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61489 req_id = fe603113-a902-41d1-b990-0c97d62acaef response_code = 200 uri = /crucible/0/regions
52024-02-12T21:15:45.555ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c
62024-02-12T21:15:45.555ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c
72024-02-12T21:15:45.612ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e9c3c514-bd63-4d03-b280-6f4306ceb53c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c" region = e9c3c514-bd63-4d03-b280-6f4306ceb53c
82024-02-12T21:15:45.761ZINFOcrucible-agent (worker): region files created ok region = e9c3c514-bd63-4d03-b280-6f4306ceb53c
92024-02-12T21:15:45.761ZINFOcrucible-agent (datafile): region e9c3c514-bd63-4d03-b280-6f4306ceb53c state: Requested -> Created
102024-02-12T21:15:45.761ZINFOcrucible-agent (worker): applying SMF actions post create...
112024-02-12T21:15:45.761ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e9c3c514-bd63-4d03-b280-6f4306ceb53c
122024-02-12T21:15:45.766ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e9c3c514-bd63-4d03-b280-6f4306ceb53c
132024-02-12T21:15:45.779ZINFOcrucible-agent (worker): creating config property group
142024-02-12T21:15:45.783ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e9c3c514-bd63-4d03-b280-6f4306ceb53c
152024-02-12T21:15:45.784ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c
162024-02-12T21:15:45.786ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
172024-02-12T21:15:45.786ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
182024-02-12T21:15:45.786ZINFOcrucible-agent (worker): commit
192024-02-12T21:15:45.795ZINFOcrucible-agent (worker): ok!
202024-02-12T21:15:45.799ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61489 req_id = 4564f18e-159f-4e7d-9f75-087bfd55e0c4 response_code = 200 uri = /crucible/0/regions
212024-02-12T21:15:45.799ZINFOcrucible-agent (worker): SMF ok!
222024-02-12T21:15:46.951ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:56403
232024-02-12T21:15:46.951ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:56403 req_id = f41f5ba2-75fe-4e3f-ae37-c413aecc69f6 response_code = 200 uri = /crucible/0/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c
242024-02-12T21:15:46.952ZINFOcrucible-agent (datafile): path is "/data/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c"
252024-02-12T21:15:46.962ZINFOcrucible-agent (datafile): dataset is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c
262024-02-12T21:15:46.971ZINFOcrucible-agent (datafile): region e9c3c514-bd63-4d03-b280-6f4306ceb53c state: Created -> Tombstoned
272024-02-12T21:15:46.971ZINFOcrucible-agent (worker): applying SMF actions before removal...
282024-02-12T21:15:46.971ZINFOcrucible-agent (dropshot): request completed latency_us = 19606 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:56403 req_id = 36758ea2-afff-43eb-8713-2ae507920bf4 response_code = 204 uri = /crucible/0/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c
292024-02-12T21:15:46.971ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:56403 req_id = 30b298a0-c3d1-4292-a8d3-906c2bb26a2b response_code = 200 uri = /crucible/0/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c
302024-02-12T21:15:46.972ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e9c3c514-bd63-4d03-b280-6f4306ceb53c (instance states: (Some(Online), None))
312024-02-12T21:15:46.977ZINFOcrucible-agent (worker): SMF ok!
322024-02-12T21:15:46.987ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c" region = e9c3c514-bd63-4d03-b280-6f4306ceb53c
332024-02-12T21:15:47.041ZINFOcrucible-agent (datafile): region e9c3c514-bd63-4d03-b280-6f4306ceb53c state: Tombstoned -> Destroyed
342024-02-12T21:15:47.121ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:56403 req_id = 95f691d8-19c4-416c-9cac-4a152296e6d7 response_code = 200 uri = /crucible/0/regions/e9c3c514-bd63-4d03-b280-6f4306ceb53c
352024-02-12T21:21:48.974ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:61598
362024-02-12T21:21:49.004ZINFOcrucible-agent (datafile): region 9446b8a1-f2df-4f4d-b580-6c6c147a752a state: Requested
372024-02-12T21:21:49.007ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
382024-02-12T21:21:49.007ZINFOcrucible-agent (dropshot): request completed latency_us = 3784 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61598 req_id = 3607bef9-07fe-4aff-b4b3-90cc861987ca response_code = 200 uri = /crucible/0/regions
392024-02-12T21:21:49.017ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/9446b8a1-f2df-4f4d-b580-6c6c147a752a
402024-02-12T21:21:49.017ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/9446b8a1-f2df-4f4d-b580-6c6c147a752a
412024-02-12T21:21:49.086ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9446b8a1-f2df-4f4d-b580-6c6c147a752a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/9446b8a1-f2df-4f4d-b580-6c6c147a752a" region = 9446b8a1-f2df-4f4d-b580-6c6c147a752a
422024-02-12T21:21:49.377ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61598 req_id = 5fe03290-280a-4efd-9d80-b4bd369df10a response_code = 200 uri = /crucible/0/regions
432024-02-12T21:21:49.437ZINFOcrucible-agent (worker): region files created ok region = 9446b8a1-f2df-4f4d-b580-6c6c147a752a
442024-02-12T21:21:49.437ZINFOcrucible-agent (datafile): region 9446b8a1-f2df-4f4d-b580-6c6c147a752a state: Requested -> Created
452024-02-12T21:21:49.437ZINFOcrucible-agent (worker): applying SMF actions post create...
462024-02-12T21:21:49.439ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9446b8a1-f2df-4f4d-b580-6c6c147a752a
472024-02-12T21:21:49.453ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9446b8a1-f2df-4f4d-b580-6c6c147a752a
482024-02-12T21:21:49.472ZINFOcrucible-agent (worker): creating config property group
492024-02-12T21:21:49.478ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9446b8a1-f2df-4f4d-b580-6c6c147a752a
502024-02-12T21:21:49.478ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9446b8a1-f2df-4f4d-b580-6c6c147a752a
512024-02-12T21:21:49.478ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522024-02-12T21:21:49.478ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
532024-02-12T21:21:49.478ZINFOcrucible-agent (worker): commit
542024-02-12T21:21:49.488ZINFOcrucible-agent (worker): ok!
552024-02-12T21:21:49.493ZINFOcrucible-agent (worker): SMF ok!
562024-02-12T21:21:50.085ZINFOcrucible-agent (dropshot): request completed latency_us = 643 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61598 req_id = 29a6e896-0354-4378-abb6-f130c1cbbac1 response_code = 200 uri = /crucible/0/regions
572024-02-12T21:21:53.550ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:47307
582024-02-12T21:21:53.550ZINFOcrucible-agent (datafile): region 19e0d072-74ae-4d3b-a9a4-a45e4539870a state: Requested
592024-02-12T21:21:53.550ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
602024-02-12T21:21:53.550ZINFOcrucible-agent (dropshot): request completed latency_us = 258 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47307 req_id = 546e4080-5a90-47f5-be40-a569ec983399 response_code = 200 uri = /crucible/0/regions
612024-02-12T21:21:53.558ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a
622024-02-12T21:21:53.558ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a
632024-02-12T21:21:53.629ZINFOcrucible-agent (worker): creating region Region { id: RegionId("19e0d072-74ae-4d3b-a9a4-a45e4539870a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a" region = 19e0d072-74ae-4d3b-a9a4-a45e4539870a
642024-02-12T21:21:53.730ZINFOcrucible-agent (worker): region files created ok region = 19e0d072-74ae-4d3b-a9a4-a45e4539870a
652024-02-12T21:21:53.730ZINFOcrucible-agent (datafile): region 19e0d072-74ae-4d3b-a9a4-a45e4539870a state: Requested -> Created
662024-02-12T21:21:53.730ZINFOcrucible-agent (worker): applying SMF actions post create...
672024-02-12T21:21:53.731ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-19e0d072-74ae-4d3b-a9a4-a45e4539870a
682024-02-12T21:21:53.738ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-19e0d072-74ae-4d3b-a9a4-a45e4539870a
692024-02-12T21:21:53.752ZINFOcrucible-agent (worker): creating config property group
702024-02-12T21:21:53.759ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-19e0d072-74ae-4d3b-a9a4-a45e4539870a
712024-02-12T21:21:53.759ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a
722024-02-12T21:21:53.759ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
732024-02-12T21:21:53.759ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
742024-02-12T21:21:53.759ZINFOcrucible-agent (worker): commit
752024-02-12T21:21:53.766ZINFOcrucible-agent (worker): ok!
762024-02-12T21:21:53.775ZINFOcrucible-agent (worker): SMF ok!
772024-02-12T21:21:53.821ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47307 req_id = 33bb374d-3b54-4d27-a6f3-6b40d7dafea6 response_code = 200 uri = /crucible/0/regions
782024-02-12T21:22:29.995ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:55433
792024-02-12T21:22:29.995ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55433 req_id = 17aea6fb-88e1-4a65-958f-b2c1d5f520a3 response_code = 200 uri = /crucible/0/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a
802024-02-12T21:22:29.996ZINFOcrucible-agent (datafile): path is "/data/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a"
812024-02-12T21:22:30.008ZINFOcrucible-agent (datafile): dataset is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a
822024-02-12T21:22:30.017ZINFOcrucible-agent (datafile): region 19e0d072-74ae-4d3b-a9a4-a45e4539870a state: Created -> Tombstoned
832024-02-12T21:22:30.017ZINFOcrucible-agent (worker): applying SMF actions before removal...
842024-02-12T21:22:30.017ZINFOcrucible-agent (dropshot): request completed latency_us = 21837 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:55433 req_id = 4b36d79f-2cb0-4bb8-a5f6-45d8de597408 response_code = 204 uri = /crucible/0/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a
852024-02-12T21:22:30.017ZINFOcrucible-agent (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55433 req_id = 97b5b6d2-d557-430c-9846-e087f1a627d9 response_code = 200 uri = /crucible/0/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a
862024-02-12T21:22:30.019ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-19e0d072-74ae-4d3b-a9a4-a45e4539870a (instance states: (Some(Online), None))
872024-02-12T21:22:30.025ZINFOcrucible-agent (worker): SMF ok!
882024-02-12T21:22:30.034ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a" region = 19e0d072-74ae-4d3b-a9a4-a45e4539870a
892024-02-12T21:22:30.087ZINFOcrucible-agent (datafile): region 19e0d072-74ae-4d3b-a9a4-a45e4539870a state: Tombstoned -> Destroyed
902024-02-12T21:22:30.093ZINFOcrucible-agent (dropshot): request completed latency_us = 94 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55433 req_id = e2dfd614-4753-4073-8ed9-8d72a6f5edbb response_code = 200 uri = /crucible/0/regions/19e0d072-74ae-4d3b-a9a4-a45e4539870a