Max level shown:
12024-10-31T00:15:13.837ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:64990
22024-10-31T00:15:13.868ZINFOcrucible-agent (datafile): region 1179157f-c214-4be8-b609-b3775eb65e40 state: Requested
32024-10-31T00:15:13.872ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42024-10-31T00:15:13.876ZINFOcrucible-agent (dropshot): request completed latency_us = 18815 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64990 req_id = 7fe8c7f3-d9a6-4713-aaa5-44fe0251317a response_code = 200 uri = /crucible/0/regions
52024-10-31T00:15:13.882ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_b43e5889-7a07-42ec-9599-254e55788daa/crucible/regions/1179157f-c214-4be8-b609-b3775eb65e40
62024-10-31T00:15:13.882ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_b43e5889-7a07-42ec-9599-254e55788daa/crucible/regions/1179157f-c214-4be8-b609-b3775eb65e40
72024-10-31T00:15:13.925ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1179157f-c214-4be8-b609-b3775eb65e40"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1179157f-c214-4be8-b609-b3775eb65e40" region = 1179157f-c214-4be8-b609-b3775eb65e40
82024-10-31T00:15:13.928ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1179157f-c214-4be8-b609-b3775eb65e40" "--data" "/data/regions/1179157f-c214-4be8-b609-b3775eb65e40" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 1179157f-c214-4be8-b609-b3775eb65e40
92024-10-31T00:15:14.068ZINFOcrucible-agent (worker): region files created ok region = 1179157f-c214-4be8-b609-b3775eb65e40
102024-10-31T00:15:14.068ZINFOcrucible-agent (datafile): region 1179157f-c214-4be8-b609-b3775eb65e40 state: Requested -> Created
112024-10-31T00:15:14.068ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-10-31T00:15:14.069ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1179157f-c214-4be8-b609-b3775eb65e40
132024-10-31T00:15:14.074ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1179157f-c214-4be8-b609-b3775eb65e40
142024-10-31T00:15:14.090ZINFOcrucible-agent (worker): creating config property group
152024-10-31T00:15:14.096ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1179157f-c214-4be8-b609-b3775eb65e40
162024-10-31T00:15:14.097ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1179157f-c214-4be8-b609-b3775eb65e40
172024-10-31T00:15:14.099ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-10-31T00:15:14.099ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192024-10-31T00:15:14.099ZINFOcrucible-agent (worker): commit
202024-10-31T00:15:14.109ZINFOcrucible-agent (worker): ok!
212024-10-31T00:15:14.112ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64990 req_id = 52301df6-0e2e-4007-9979-fc77e1e5709a response_code = 200 uri = /crucible/0/regions
222024-10-31T00:15:14.114ZINFOcrucible-agent (worker): SMF ok!
232024-10-31T00:15:15.128ZINFOcrucible-agent (dropshot): request completed latency_us = 92 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64990 req_id = 63904714-6845-426a-882d-51b4dde4e26c response_code = 200 uri = /crucible/0/regions/1179157f-c214-4be8-b609-b3775eb65e40
242024-10-31T00:15:15.130ZINFOcrucible-agent (datafile): path is "/data/regions/1179157f-c214-4be8-b609-b3775eb65e40"
252024-10-31T00:15:15.142ZINFOcrucible-agent (datafile): dataset is oxp_b43e5889-7a07-42ec-9599-254e55788daa/crucible/regions/1179157f-c214-4be8-b609-b3775eb65e40
262024-10-31T00:15:15.152ZINFOcrucible-agent (datafile): region 1179157f-c214-4be8-b609-b3775eb65e40 state: Created -> Tombstoned
272024-10-31T00:15:15.152ZINFOcrucible-agent (worker): applying SMF actions before removal...
282024-10-31T00:15:15.154ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-1179157f-c214-4be8-b609-b3775eb65e40 (instance states: (Some(Online), None))
292024-10-31T00:15:15.154ZINFOcrucible-agent (dropshot): request completed latency_us = 24296 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:64990 req_id = 2eec0ecf-916a-45ec-accc-3b79c8c4c4db response_code = 204 uri = /crucible/0/regions/1179157f-c214-4be8-b609-b3775eb65e40
302024-10-31T00:15:15.157ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64990 req_id = a8ee0140-4a8a-442c-b7b3-fdb7a913ab12 response_code = 200 uri = /crucible/0/regions/1179157f-c214-4be8-b609-b3775eb65e40
312024-10-31T00:15:15.159ZINFOcrucible-agent (worker): SMF ok!
322024-10-31T00:15:15.170ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b43e5889-7a07-42ec-9599-254e55788daa/crucible/regions/1179157f-c214-4be8-b609-b3775eb65e40" region = 1179157f-c214-4be8-b609-b3775eb65e40
332024-10-31T00:15:15.222ZINFOcrucible-agent (datafile): region 1179157f-c214-4be8-b609-b3775eb65e40 state: Tombstoned -> Destroyed
342024-10-31T00:15:15.291ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64990 req_id = 4b1a9650-9781-47e6-8a28-a680af5e8b64 response_code = 200 uri = /crucible/0/regions/1179157f-c214-4be8-b609-b3775eb65e40
352024-10-31T00:18:34.772ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:49680
362024-10-31T00:18:34.772ZINFOcrucible-agent (datafile): region 59d00940-6657-4b3c-bbd2-866e83534a51 state: Requested
372024-10-31T00:18:34.773ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
382024-10-31T00:18:34.773ZINFOcrucible-agent (dropshot): request completed latency_us = 664 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49680 req_id = cceabe92-6ab8-4137-bb0b-a88385153aac response_code = 200 uri = /crucible/0/regions
392024-10-31T00:18:34.782ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b43e5889-7a07-42ec-9599-254e55788daa/crucible/regions/59d00940-6657-4b3c-bbd2-866e83534a51
402024-10-31T00:18:34.782ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b43e5889-7a07-42ec-9599-254e55788daa/crucible/regions/59d00940-6657-4b3c-bbd2-866e83534a51
412024-10-31T00:18:34.824ZINFOcrucible-agent (worker): creating region Region { id: RegionId("59d00940-6657-4b3c-bbd2-866e83534a51"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/59d00940-6657-4b3c-bbd2-866e83534a51" region = 59d00940-6657-4b3c-bbd2-866e83534a51
422024-10-31T00:18:34.826ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "59d00940-6657-4b3c-bbd2-866e83534a51" "--data" "/data/regions/59d00940-6657-4b3c-bbd2-866e83534a51" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 59d00940-6657-4b3c-bbd2-866e83534a51
432024-10-31T00:18:34.926ZINFOcrucible-agent (worker): region files created ok region = 59d00940-6657-4b3c-bbd2-866e83534a51
442024-10-31T00:18:34.926ZINFOcrucible-agent (datafile): region 59d00940-6657-4b3c-bbd2-866e83534a51 state: Requested -> Created
452024-10-31T00:18:34.926ZINFOcrucible-agent (worker): applying SMF actions post create...
462024-10-31T00:18:34.927ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-59d00940-6657-4b3c-bbd2-866e83534a51
472024-10-31T00:18:34.932ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-59d00940-6657-4b3c-bbd2-866e83534a51
482024-10-31T00:18:34.945ZINFOcrucible-agent (worker): creating config property group
492024-10-31T00:18:34.949ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-59d00940-6657-4b3c-bbd2-866e83534a51
502024-10-31T00:18:34.949ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/59d00940-6657-4b3c-bbd2-866e83534a51
512024-10-31T00:18:34.949ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522024-10-31T00:18:34.949ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
532024-10-31T00:18:34.949ZINFOcrucible-agent (worker): commit
542024-10-31T00:18:34.953ZINFOcrucible-agent (worker): ok!
552024-10-31T00:18:34.958ZINFOcrucible-agent (worker): SMF ok!
562024-10-31T00:18:34.987ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49680 req_id = 83fc005e-051c-40ef-90fa-5ec5f34ce315 response_code = 200 uri = /crucible/0/regions
572024-10-31T00:19:00.024ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49680 req_id = b0b90cd1-d60a-4fea-b7f4-2dbf0fd5b98e response_code = 200 uri = /crucible/0/regions/59d00940-6657-4b3c-bbd2-866e83534a51
582024-10-31T00:19:00.027ZINFOcrucible-agent (datafile): path is "/data/regions/59d00940-6657-4b3c-bbd2-866e83534a51"
592024-10-31T00:19:00.040ZINFOcrucible-agent (datafile): dataset is oxp_b43e5889-7a07-42ec-9599-254e55788daa/crucible/regions/59d00940-6657-4b3c-bbd2-866e83534a51
602024-10-31T00:19:00.050ZINFOcrucible-agent (datafile): region 59d00940-6657-4b3c-bbd2-866e83534a51 state: Created -> Tombstoned
612024-10-31T00:19:00.050ZINFOcrucible-agent (worker): applying SMF actions before removal...
622024-10-31T00:19:00.050ZINFOcrucible-agent (dropshot): request completed latency_us = 23407 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:49680 req_id = 2f71b3b5-c1bd-4e0a-a209-2ba1fbb2b48e response_code = 204 uri = /crucible/0/regions/59d00940-6657-4b3c-bbd2-866e83534a51
632024-10-31T00:19:00.052ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-59d00940-6657-4b3c-bbd2-866e83534a51 (instance states: (Some(Online), None))
642024-10-31T00:19:00.054ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49680 req_id = d9216570-256f-4e42-9b66-e4f9d2f10480 response_code = 200 uri = /crucible/0/regions/59d00940-6657-4b3c-bbd2-866e83534a51
652024-10-31T00:19:00.058ZINFOcrucible-agent (worker): SMF ok!
662024-10-31T00:19:00.069ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b43e5889-7a07-42ec-9599-254e55788daa/crucible/regions/59d00940-6657-4b3c-bbd2-866e83534a51" region = 59d00940-6657-4b3c-bbd2-866e83534a51
672024-10-31T00:19:00.124ZINFOcrucible-agent (datafile): region 59d00940-6657-4b3c-bbd2-866e83534a51 state: Tombstoned -> Destroyed
682024-10-31T00:19:00.191ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49680 req_id = c779634b-aed0-478b-a148-82ed4544b031 response_code = 200 uri = /crucible/0/regions/59d00940-6657-4b3c-bbd2-866e83534a51