Max level shown:
12024-02-16T03:03:07.601ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:56553
22024-02-16T03:03:07.601ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56553 req_id = 7653937b-9718-4073-a0d4-0a266fb4ca62 response_code = 200 uri = /crucible/0/regions/c13a88b5-9eb1-4029-9582-3986824ad027
32024-02-16T03:03:07.607ZINFOcrucible-agent (datafile): path is "/data/regions/c13a88b5-9eb1-4029-9582-3986824ad027"
42024-02-16T03:03:07.618ZINFOcrucible-agent (datafile): dataset is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/c13a88b5-9eb1-4029-9582-3986824ad027
52024-02-16T03:03:07.628ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/c13a88b5-9eb1-4029-9582-3986824ad027@4d67639d-fe66-4540-b335-76f647063e02
62024-02-16T03:03:07.628ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/c13a88b5-9eb1-4029-9582-3986824ad027", "4d67639d-fe66-4540-b335-76f647063e02"]
72024-02-16T03:03:07.639ZINFOcrucible-agent (dropshot): request completed latency_us = 38088 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56553 req_id = 0df7e141-81e0-4642-a2d5-ed230ae35c8f response_code = 200 uri = /crucible/0/regions/c13a88b5-9eb1-4029-9582-3986824ad027/snapshots/4d67639d-fe66-4540-b335-76f647063e02
82024-02-16T03:03:07.640ZINFOcrucible-agent (datafile): path is "/data/regions/c13a88b5-9eb1-4029-9582-3986824ad027"
92024-02-16T03:03:07.648ZINFOcrucible-agent (datafile): dataset is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/c13a88b5-9eb1-4029-9582-3986824ad027
102024-02-16T03:03:07.657ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/c13a88b5-9eb1-4029-9582-3986824ad027@4d67639d-fe66-4540-b335-76f647063e02
112024-02-16T03:03:07.657ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/c13a88b5-9eb1-4029-9582-3986824ad027", "4d67639d-fe66-4540-b335-76f647063e02"]
122024-02-16T03:03:07.667ZINFOcrucible-agent (datafile): requesting running snapshot c13a88b5-9eb1-4029-9582-3986824ad027-4d67639d-fe66-4540-b335-76f647063e02 state: Requested
132024-02-16T03:03:07.667ZINFOcrucible-agent (worker): applying SMF actions for region c13a88b5-9eb1-4029-9582-3986824ad027 running snapshot 4d67639d-fe66-4540-b335-76f647063e02 (state Requested)...
142024-02-16T03:03:07.667ZINFOcrucible-agent (dropshot): request completed latency_us = 27806 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56553 req_id = 8f58d53a-ae0c-41c1-a6a3-abd391f91962 response_code = 200 uri = /crucible/0/regions/c13a88b5-9eb1-4029-9582-3986824ad027/snapshots/4d67639d-fe66-4540-b335-76f647063e02/run
152024-02-16T03:03:07.673ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-c13a88b5-9eb1-4029-9582-3986824ad027-4d67639d-fe66-4540-b335-76f647063e02
162024-02-16T03:03:07.679ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-c13a88b5-9eb1-4029-9582-3986824ad027-4d67639d-fe66-4540-b335-76f647063e02
172024-02-16T03:03:07.691ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-c13a88b5-9eb1-4029-9582-3986824ad027-4d67639d-fe66-4540-b335-76f647063e02
182024-02-16T03:03:07.691ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c13a88b5-9eb1-4029-9582-3986824ad027/.zfs/snapshot/4d67639d-fe66-4540-b335-76f647063e02
192024-02-16T03:03:07.691ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
202024-02-16T03:03:07.691ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
212024-02-16T03:03:07.691ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
222024-02-16T03:03:07.692ZINFOcrucible-agent (worker): commit
232024-02-16T03:03:07.696ZINFOcrucible-agent (worker): ok!
242024-02-16T03:03:07.701ZINFOcrucible-agent (worker): SMF ok!
252024-02-16T03:03:07.701ZINFOcrucible-agent (datafile): region c13a88b5-9eb1-4029-9582-3986824ad027 running snapshot 4d67639d-fe66-4540-b335-76f647063e02 state: Requested -> Created
262024-02-16T03:03:10.106ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:34630
272024-02-16T03:03:10.166ZINFOcrucible-agent (datafile): region e714813c-0656-466a-90ca-1398998e34af state: Requested
282024-02-16T03:03:10.166ZINFOcrucible-agent (dropshot): request completed latency_us = 1009 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34630 req_id = 7ea38e82-4bda-4bdc-9a56-eb4ae445729a response_code = 200 uri = /crucible/0/regions
292024-02-16T03:03:10.166ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
302024-02-16T03:03:10.175ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/e714813c-0656-466a-90ca-1398998e34af
312024-02-16T03:03:10.175ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/e714813c-0656-466a-90ca-1398998e34af
322024-02-16T03:03:10.231ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e714813c-0656-466a-90ca-1398998e34af"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/e714813c-0656-466a-90ca-1398998e34af" region = e714813c-0656-466a-90ca-1398998e34af
332024-02-16T03:03:10.334ZINFOcrucible-agent (worker): region files created ok region = e714813c-0656-466a-90ca-1398998e34af
342024-02-16T03:03:10.334ZINFOcrucible-agent (datafile): region e714813c-0656-466a-90ca-1398998e34af state: Requested -> Created
352024-02-16T03:03:10.334ZINFOcrucible-agent (worker): applying SMF actions post create...
362024-02-16T03:03:10.335ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e714813c-0656-466a-90ca-1398998e34af
372024-02-16T03:03:10.344ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e714813c-0656-466a-90ca-1398998e34af
382024-02-16T03:03:10.352ZINFOcrucible-agent (worker): creating config property group
392024-02-16T03:03:10.355ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e714813c-0656-466a-90ca-1398998e34af
402024-02-16T03:03:10.355ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e714813c-0656-466a-90ca-1398998e34af
412024-02-16T03:03:10.355ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422024-02-16T03:03:10.355ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432024-02-16T03:03:10.355ZINFOcrucible-agent (worker): commit
442024-02-16T03:03:10.359ZINFOcrucible-agent (worker): ok!
452024-02-16T03:03:10.365ZINFOcrucible-agent (worker): SMF ok!
462024-02-16T03:03:10.396ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34630 req_id = 61b7ad4e-ff94-4eb5-8de5-e804fc6496ec response_code = 200 uri = /crucible/0/regions
472024-02-16T03:03:42.444ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:62422
482024-02-16T03:03:42.444ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:62422 req_id = aba5d230-e526-4c11-9e4a-877e4a021885 response_code = 200 uri = /crucible/0/regions/e714813c-0656-466a-90ca-1398998e34af
492024-02-16T03:03:42.444ZINFOcrucible-agent (datafile): path is "/data/regions/e714813c-0656-466a-90ca-1398998e34af"
502024-02-16T03:03:42.457ZINFOcrucible-agent (datafile): dataset is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/e714813c-0656-466a-90ca-1398998e34af
512024-02-16T03:03:42.466ZINFOcrucible-agent (datafile): region e714813c-0656-466a-90ca-1398998e34af state: Created -> Tombstoned
522024-02-16T03:03:42.466ZINFOcrucible-agent (worker): applying SMF actions before removal...
532024-02-16T03:03:42.466ZINFOcrucible-agent (dropshot): request completed latency_us = 21927 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:62422 req_id = 2ae6ed9b-6697-44a8-8b86-5a53e692cab7 response_code = 204 uri = /crucible/0/regions/e714813c-0656-466a-90ca-1398998e34af
542024-02-16T03:03:42.466ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:62422 req_id = 2ff237d2-6602-4cb4-b0bf-5591ead53f02 response_code = 200 uri = /crucible/0/regions/e714813c-0656-466a-90ca-1398998e34af
552024-02-16T03:03:42.467ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e714813c-0656-466a-90ca-1398998e34af (instance states: (Some(Online), None))
562024-02-16T03:03:42.474ZINFOcrucible-agent (worker): SMF ok!
572024-02-16T03:03:42.483ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/e714813c-0656-466a-90ca-1398998e34af" region = e714813c-0656-466a-90ca-1398998e34af
582024-02-16T03:03:42.534ZINFOcrucible-agent (datafile): region e714813c-0656-466a-90ca-1398998e34af state: Tombstoned -> Destroyed
592024-02-16T03:03:42.584ZINFOcrucible-agent (dropshot): request completed latency_us = 104 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:62422 req_id = 0a9719d8-5d9e-4bb6-a65e-2911bdeb40de response_code = 200 uri = /crucible/0/regions/e714813c-0656-466a-90ca-1398998e34af