Max level shown:
1 [ Nov 27 20:46:55 Enabled. ]
2 [ Nov 27 20:46:55 Rereading configuration. ]
3 [ Nov 27 20:47:01 Rereading configuration. ]
4 [ Nov 27 20:47:06 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-11-27T20:47:07.034ZINFOcrucible-agent: dataset: "oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible"
72024-11-27T20:47:07.037ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-11-27T20:47:07.037ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-11-27T20:47:07.054ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-11-27T20:47:07.176ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-11-27T20:47:40.984ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:43683
122024-11-27T20:47:41.017ZINFOcrucible-agent (datafile): region bcd44cae-a18b-475a-8b5d-95d839c9b836 state: Requested
132024-11-27T20:47:41.021ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-11-27T20:47:41.026ZINFOcrucible-agent (dropshot): request completed latency_us = 14891 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43683 req_id = 66196874-e65e-4eb8-9798-57588832e43e response_code = 200 uri = /crucible/0/regions
152024-11-27T20:47:41.033ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836
162024-11-27T20:47:41.033ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836
172024-11-27T20:47:41.092ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bcd44cae-a18b-475a-8b5d-95d839c9b836"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836" region = bcd44cae-a18b-475a-8b5d-95d839c9b836
182024-11-27T20:47:41.095ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bcd44cae-a18b-475a-8b5d-95d839c9b836" "--data" "/data/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = bcd44cae-a18b-475a-8b5d-95d839c9b836
192024-11-27T20:47:41.224ZINFOcrucible-agent (worker): region files created ok region = bcd44cae-a18b-475a-8b5d-95d839c9b836
202024-11-27T20:47:41.224ZINFOcrucible-agent (datafile): region bcd44cae-a18b-475a-8b5d-95d839c9b836 state: Requested -> Created
212024-11-27T20:47:41.224ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-11-27T20:47:41.224ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bcd44cae-a18b-475a-8b5d-95d839c9b836
232024-11-27T20:47:41.234ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bcd44cae-a18b-475a-8b5d-95d839c9b836
242024-11-27T20:47:41.247ZINFOcrucible-agent (worker): creating config property group
252024-11-27T20:47:41.251ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bcd44cae-a18b-475a-8b5d-95d839c9b836
262024-11-27T20:47:41.252ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836
272024-11-27T20:47:41.252ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-11-27T20:47:41.252ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
292024-11-27T20:47:41.252ZINFOcrucible-agent (worker): commit
302024-11-27T20:47:41.258ZINFOcrucible-agent (worker): ok!
312024-11-27T20:47:41.262ZINFOcrucible-agent (worker): SMF ok!
322024-11-27T20:47:41.322ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:43683 req_id = 541ca8ed-a588-482e-a20e-db65b50ecbea response_code = 200 uri = /crucible/0/regions
332024-11-27T20:47:42.384ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:43683 req_id = d757d7c6-f307-42b3-b5f1-554ac62085bd response_code = 200 uri = /crucible/0/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836
342024-11-27T20:47:42.389ZINFOcrucible-agent (datafile): path is "/data/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836"
352024-11-27T20:47:42.400ZINFOcrucible-agent (datafile): dataset is oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836
362024-11-27T20:47:42.412ZINFOcrucible-agent (datafile): region bcd44cae-a18b-475a-8b5d-95d839c9b836 state: Created -> Tombstoned
372024-11-27T20:47:42.412ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-11-27T20:47:42.412ZINFOcrucible-agent (dropshot): request completed latency_us = 23353 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:43683 req_id = 50b32d42-1ddc-4669-9367-0244963f5347 response_code = 204 uri = /crucible/0/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836
392024-11-27T20:47:42.415ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-bcd44cae-a18b-475a-8b5d-95d839c9b836 (instance states: (Some(Online), None))
402024-11-27T20:47:42.415ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:43683 req_id = 1965aba6-472f-4d43-9ce5-be002e2da996 response_code = 200 uri = /crucible/0/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836
412024-11-27T20:47:42.420ZINFOcrucible-agent (worker): SMF ok!
422024-11-27T20:47:42.432ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836" region = bcd44cae-a18b-475a-8b5d-95d839c9b836
432024-11-27T20:47:42.498ZINFOcrucible-agent (datafile): region bcd44cae-a18b-475a-8b5d-95d839c9b836 state: Tombstoned -> Destroyed
442024-11-27T20:47:42.516ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:43683 req_id = 774a494f-2427-4f63-bfa2-6e43dc6cc1e3 response_code = 200 uri = /crucible/0/regions/bcd44cae-a18b-475a-8b5d-95d839c9b836
452024-11-27T20:48:17.846ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:33202
462024-11-27T20:48:17.847ZINFOcrucible-agent (datafile): region bf5b8391-1cd2-4eb3-b716-5707c2379d4c state: Requested
472024-11-27T20:48:17.847ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-11-27T20:48:17.847ZINFOcrucible-agent (dropshot): request completed latency_us = 200 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33202 req_id = 7221541d-c784-4eb8-811f-2d5c7cf8a45e response_code = 200 uri = /crucible/0/regions
492024-11-27T20:48:17.857ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c
502024-11-27T20:48:17.857ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c
512024-11-27T20:48:17.912ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bf5b8391-1cd2-4eb3-b716-5707c2379d4c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c" region = bf5b8391-1cd2-4eb3-b716-5707c2379d4c
522024-11-27T20:48:17.912ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bf5b8391-1cd2-4eb3-b716-5707c2379d4c" "--data" "/data/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = bf5b8391-1cd2-4eb3-b716-5707c2379d4c
532024-11-27T20:48:17.981ZINFOcrucible-agent (worker): region files created ok region = bf5b8391-1cd2-4eb3-b716-5707c2379d4c
542024-11-27T20:48:17.981ZINFOcrucible-agent (datafile): region bf5b8391-1cd2-4eb3-b716-5707c2379d4c state: Requested -> Created
552024-11-27T20:48:17.982ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-11-27T20:48:17.983ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bf5b8391-1cd2-4eb3-b716-5707c2379d4c
572024-11-27T20:48:17.987ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bf5b8391-1cd2-4eb3-b716-5707c2379d4c
582024-11-27T20:48:17.994ZINFOcrucible-agent (worker): creating config property group
592024-11-27T20:48:17.997ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bf5b8391-1cd2-4eb3-b716-5707c2379d4c
602024-11-27T20:48:17.997ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c
612024-11-27T20:48:17.997ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-11-27T20:48:17.998ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
632024-11-27T20:48:17.998ZINFOcrucible-agent (worker): commit
642024-11-27T20:48:18.001ZINFOcrucible-agent (worker): ok!
652024-11-27T20:48:18.006ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33202 req_id = b4494c9b-8104-42ab-9df7-2c1e2788c650 response_code = 200 uri = /crucible/0/regions
662024-11-27T20:48:18.006ZINFOcrucible-agent (worker): SMF ok!
672024-11-27T20:58:35.492ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:59775
682024-11-27T20:58:35.492ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59775 req_id = a19631ea-e2ce-4b08-9c9d-f8802f631751 response_code = 200 uri = /crucible/0/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c
692024-11-27T20:58:35.495ZINFOcrucible-agent (datafile): path is "/data/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c"
702024-11-27T20:58:35.504ZINFOcrucible-agent (datafile): dataset is oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c
712024-11-27T20:58:35.513ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c@86679e40-3ae8-48dd-afdd-3011492f2628
722024-11-27T20:58:35.513ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c", "86679e40-3ae8-48dd-afdd-3011492f2628"]
732024-11-27T20:58:35.526ZINFOcrucible-agent (dropshot): request completed latency_us = 30402 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59775 req_id = f6846351-4451-4dd3-9e59-c006a04ffdf0 response_code = 200 uri = /crucible/0/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c/snapshots/86679e40-3ae8-48dd-afdd-3011492f2628
742024-11-27T20:58:35.529ZINFOcrucible-agent (datafile): path is "/data/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c"
752024-11-27T20:58:35.537ZINFOcrucible-agent (datafile): dataset is oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c
762024-11-27T20:58:35.545ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c@86679e40-3ae8-48dd-afdd-3011492f2628
772024-11-27T20:58:35.545ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c", "86679e40-3ae8-48dd-afdd-3011492f2628"]
782024-11-27T20:58:35.555ZINFOcrucible-agent (datafile): requesting running snapshot bf5b8391-1cd2-4eb3-b716-5707c2379d4c-86679e40-3ae8-48dd-afdd-3011492f2628 state: Requested
792024-11-27T20:58:35.556ZINFOcrucible-agent (worker): applying SMF actions for region bf5b8391-1cd2-4eb3-b716-5707c2379d4c running snapshot 86679e40-3ae8-48dd-afdd-3011492f2628 (state Requested)...
802024-11-27T20:58:35.556ZINFOcrucible-agent (dropshot): request completed latency_us = 26951 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59775 req_id = dba7b587-c309-43b7-a3ff-c78afcdb4c59 response_code = 200 uri = /crucible/0/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c/snapshots/86679e40-3ae8-48dd-afdd-3011492f2628/run
812024-11-27T20:58:35.563ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-bf5b8391-1cd2-4eb3-b716-5707c2379d4c-86679e40-3ae8-48dd-afdd-3011492f2628
822024-11-27T20:58:35.575ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-bf5b8391-1cd2-4eb3-b716-5707c2379d4c-86679e40-3ae8-48dd-afdd-3011492f2628
832024-11-27T20:58:35.586ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-bf5b8391-1cd2-4eb3-b716-5707c2379d4c-86679e40-3ae8-48dd-afdd-3011492f2628
842024-11-27T20:58:35.587ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c/.zfs/snapshot/86679e40-3ae8-48dd-afdd-3011492f2628
852024-11-27T20:58:35.587ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
862024-11-27T20:58:35.587ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
872024-11-27T20:58:35.587ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
882024-11-27T20:58:35.587ZINFOcrucible-agent (worker): commit
892024-11-27T20:58:35.590ZINFOcrucible-agent (worker): ok!
902024-11-27T20:58:35.595ZINFOcrucible-agent (worker): SMF ok!
912024-11-27T20:58:35.595ZINFOcrucible-agent (datafile): region bf5b8391-1cd2-4eb3-b716-5707c2379d4c running snapshot 86679e40-3ae8-48dd-afdd-3011492f2628 state: Requested -> Created
922024-11-27T20:58:35.917ZINFOcrucible-agent (datafile): path is "/data/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c"
932024-11-27T20:58:35.926ZINFOcrucible-agent (datafile): dataset is oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c
942024-11-27T20:58:35.935ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c@86679e40-3ae8-48dd-afdd-3011492f2628
952024-11-27T20:58:35.935ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c", "86679e40-3ae8-48dd-afdd-3011492f2628"]
962024-11-27T20:58:35.943ZINFOcrucible-agent (dropshot): request completed latency_us = 26166 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59775 req_id = 4fddeb35-d26d-410d-9193-eaaf81a5f6fd response_code = 200 uri = /crucible/0/regions/bf5b8391-1cd2-4eb3-b716-5707c2379d4c/snapshots/86679e40-3ae8-48dd-afdd-3011492f2628/run
972024-11-27T20:58:39.336ZINFOcrucible-agent (datafile): region 6ef46c27-3406-453e-a1be-8b75d37b8940 state: Requested
982024-11-27T20:58:39.336ZINFOcrucible-agent (dropshot): request completed latency_us = 233 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59775 req_id = b7a9551b-abdf-4746-b635-ba1bf7280b05 response_code = 200 uri = /crucible/0/regions
992024-11-27T20:58:39.336ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1002024-11-27T20:58:39.346ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/6ef46c27-3406-453e-a1be-8b75d37b8940
1012024-11-27T20:58:39.346ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/6ef46c27-3406-453e-a1be-8b75d37b8940
1022024-11-27T20:58:39.402ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6ef46c27-3406-453e-a1be-8b75d37b8940"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6ef46c27-3406-453e-a1be-8b75d37b8940" region = 6ef46c27-3406-453e-a1be-8b75d37b8940
1032024-11-27T20:58:39.404ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6ef46c27-3406-453e-a1be-8b75d37b8940" "--data" "/data/regions/6ef46c27-3406-453e-a1be-8b75d37b8940" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6ef46c27-3406-453e-a1be-8b75d37b8940
1042024-11-27T20:58:39.472ZINFOcrucible-agent (worker): region files created ok region = 6ef46c27-3406-453e-a1be-8b75d37b8940
1052024-11-27T20:58:39.472ZINFOcrucible-agent (datafile): region 6ef46c27-3406-453e-a1be-8b75d37b8940 state: Requested -> Created
1062024-11-27T20:58:39.472ZINFOcrucible-agent (worker): applying SMF actions post create...
1072024-11-27T20:58:39.473ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6ef46c27-3406-453e-a1be-8b75d37b8940
1082024-11-27T20:58:39.476ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6ef46c27-3406-453e-a1be-8b75d37b8940
1092024-11-27T20:58:39.484ZINFOcrucible-agent (worker): creating config property group
1102024-11-27T20:58:39.488ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6ef46c27-3406-453e-a1be-8b75d37b8940
1112024-11-27T20:58:39.488ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6ef46c27-3406-453e-a1be-8b75d37b8940
1122024-11-27T20:58:39.488ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1132024-11-27T20:58:39.488ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1142024-11-27T20:58:39.488ZINFOcrucible-agent (worker): commit
1152024-11-27T20:58:39.492ZINFOcrucible-agent (worker): ok!
1162024-11-27T20:58:39.501ZINFOcrucible-agent (worker): SMF ok!
1172024-11-27T20:58:39.696ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59775 req_id = cb715399-10f9-4a9a-8161-77238c858ada response_code = 200 uri = /crucible/0/regions
1182024-11-27T20:59:04.376ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59775 req_id = 67095a6b-7815-4c88-b62d-bf362b1b060e response_code = 200 uri = /crucible/0/regions/6ef46c27-3406-453e-a1be-8b75d37b8940
1192024-11-27T20:59:04.380ZINFOcrucible-agent (datafile): path is "/data/regions/6ef46c27-3406-453e-a1be-8b75d37b8940"
1202024-11-27T20:59:04.392ZINFOcrucible-agent (datafile): dataset is oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/6ef46c27-3406-453e-a1be-8b75d37b8940
1212024-11-27T20:59:04.401ZINFOcrucible-agent (datafile): region 6ef46c27-3406-453e-a1be-8b75d37b8940 state: Created -> Tombstoned
1222024-11-27T20:59:04.401ZINFOcrucible-agent (worker): applying SMF actions before removal...
1232024-11-27T20:59:04.401ZINFOcrucible-agent (dropshot): request completed latency_us = 21289 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:59775 req_id = d15ddfbc-8196-40f7-ae2b-0c11b725f70c response_code = 204 uri = /crucible/0/regions/6ef46c27-3406-453e-a1be-8b75d37b8940
1242024-11-27T20:59:04.403ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6ef46c27-3406-453e-a1be-8b75d37b8940 (instance states: (Some(Online), None))
1252024-11-27T20:59:04.405ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59775 req_id = c43800c8-8261-453d-9a29-94a3c4aa029a response_code = 200 uri = /crucible/0/regions/6ef46c27-3406-453e-a1be-8b75d37b8940
1262024-11-27T20:59:04.409ZINFOcrucible-agent (worker): SMF ok!
1272024-11-27T20:59:04.420ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f94a6d1b-9178-4c13-817f-a77b6a6cd97e/crucible/regions/6ef46c27-3406-453e-a1be-8b75d37b8940" region = 6ef46c27-3406-453e-a1be-8b75d37b8940
1282024-11-27T20:59:04.468ZINFOcrucible-agent (datafile): region 6ef46c27-3406-453e-a1be-8b75d37b8940 state: Tombstoned -> Destroyed
1292024-11-27T20:59:04.489ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59775 req_id = 1551ef8c-881c-434a-9efc-93418d6a47a0 response_code = 200 uri = /crucible/0/regions/6ef46c27-3406-453e-a1be-8b75d37b8940