Max level shown:
1 [ Feb 29 22:26:02 Enabled. ]
2 [ Feb 29 22:26:02 Rereading configuration. ]
3 [ Feb 29 22:26:05 Rereading configuration. ]
4 [ Feb 29 22:26:06 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-02-29T22:26:06.946ZINFOcrucible-agent: dataset: "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"
72024-02-29T22:26:06.947ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-02-29T22:26:06.947ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-02-29T22:26:07.092ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
102024-02-29T22:26:47.809ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:52383
112024-02-29T22:26:47.837ZINFOcrucible-agent (datafile): region ed7b38ba-aab8-4572-a394-db0ba38dcf62 state: Requested
122024-02-29T22:26:47.840ZINFOcrucible-agent (dropshot): request completed latency_us = 15228 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52383 req_id = 69b84b84-5518-4f94-a494-d474bc9c5d89 response_code = 200 uri = /crucible/0/regions
132024-02-29T22:26:47.840ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-02-29T22:26:47.848ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
152024-02-29T22:26:47.849ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
162024-02-29T22:26:47.986ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ed7b38ba-aab8-4572-a394-db0ba38dcf62"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62" region = ed7b38ba-aab8-4572-a394-db0ba38dcf62
172024-02-29T22:26:48.091ZINFOcrucible-agent (dropshot): request completed latency_us = 746 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52383 req_id = 00c3cd7b-5924-4c79-a847-57c39116199a response_code = 200 uri = /crucible/0/regions
182024-02-29T22:26:48.292ZINFOcrucible-agent (worker): region files created ok region = ed7b38ba-aab8-4572-a394-db0ba38dcf62
192024-02-29T22:26:48.292ZINFOcrucible-agent (datafile): region ed7b38ba-aab8-4572-a394-db0ba38dcf62 state: Requested -> Created
202024-02-29T22:26:48.292ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-02-29T22:26:48.293ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ed7b38ba-aab8-4572-a394-db0ba38dcf62
222024-02-29T22:26:48.319ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ed7b38ba-aab8-4572-a394-db0ba38dcf62
232024-02-29T22:26:48.363ZINFOcrucible-agent (worker): creating config property group
242024-02-29T22:26:48.382ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ed7b38ba-aab8-4572-a394-db0ba38dcf62
252024-02-29T22:26:48.414ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
262024-02-29T22:26:48.416ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-02-29T22:26:48.416ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
282024-02-29T22:26:48.416ZINFOcrucible-agent (worker): commit
292024-02-29T22:26:48.433ZINFOcrucible-agent (worker): ok!
302024-02-29T22:26:48.455ZINFOcrucible-agent (worker): SMF ok!
312024-02-29T22:26:48.799ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52383 req_id = 04c92002-8c1f-4f3c-9bf6-de7773f8f17f response_code = 200 uri = /crucible/0/regions
322024-02-29T22:26:50.386ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:61422
332024-02-29T22:26:50.388ZINFOcrucible-agent (dropshot): request completed latency_us = 2016 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61422 req_id = cd44a94c-4a5c-47af-8cf2-52579e9a610b response_code = 200 uri = /crucible/0/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
342024-02-29T22:26:50.389ZINFOcrucible-agent (datafile): path is "/data/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62"
352024-02-29T22:26:50.398ZINFOcrucible-agent (datafile): dataset is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
362024-02-29T22:26:50.407ZINFOcrucible-agent (datafile): region ed7b38ba-aab8-4572-a394-db0ba38dcf62 state: Created -> Tombstoned
372024-02-29T22:26:50.408ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-02-29T22:26:50.408ZINFOcrucible-agent (dropshot): request completed latency_us = 19208 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:61422 req_id = d0274a54-bf35-482a-a738-375870818ca6 response_code = 204 uri = /crucible/0/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
392024-02-29T22:26:50.408ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61422 req_id = 34e5a749-b26e-4588-8dd2-5d3466f91984 response_code = 200 uri = /crucible/0/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
402024-02-29T22:26:50.409ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ed7b38ba-aab8-4572-a394-db0ba38dcf62 (instance states: (Some(Online), None))
412024-02-29T22:26:50.444ZINFOcrucible-agent (worker): SMF ok!
422024-02-29T22:26:50.455ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62" region = ed7b38ba-aab8-4572-a394-db0ba38dcf62
432024-02-29T22:26:50.539ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61422 req_id = cb96b43b-47bd-4595-abfc-ca48d3807d2f response_code = 200 uri = /crucible/0/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
442024-02-29T22:26:50.584ZINFOcrucible-agent (datafile): region ed7b38ba-aab8-4572-a394-db0ba38dcf62 state: Tombstoned -> Destroyed
452024-02-29T22:26:50.681ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61422 req_id = eaed57aa-48fa-4bf0-95d1-82dd0b132833 response_code = 200 uri = /crucible/0/regions/ed7b38ba-aab8-4572-a394-db0ba38dcf62
462024-02-29T22:27:29.577ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:58676
472024-02-29T22:27:29.606ZINFOcrucible-agent (datafile): region 791562f7-d4c3-48d2-ae65-0e8d83f43dd6 state: Requested
482024-02-29T22:27:29.606ZINFOcrucible-agent (dropshot): request completed latency_us = 274 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58676 req_id = 9a6bfda3-cd87-4b41-894e-721f4b082f15 response_code = 200 uri = /crucible/0/regions
492024-02-29T22:27:29.606ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502024-02-29T22:27:29.614ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/791562f7-d4c3-48d2-ae65-0e8d83f43dd6
512024-02-29T22:27:29.614ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/791562f7-d4c3-48d2-ae65-0e8d83f43dd6
522024-02-29T22:27:29.692ZINFOcrucible-agent (worker): creating region Region { id: RegionId("791562f7-d4c3-48d2-ae65-0e8d83f43dd6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/791562f7-d4c3-48d2-ae65-0e8d83f43dd6" region = 791562f7-d4c3-48d2-ae65-0e8d83f43dd6
532024-02-29T22:27:29.811ZINFOcrucible-agent (worker): region files created ok region = 791562f7-d4c3-48d2-ae65-0e8d83f43dd6
542024-02-29T22:27:29.811ZINFOcrucible-agent (datafile): region 791562f7-d4c3-48d2-ae65-0e8d83f43dd6 state: Requested -> Created
552024-02-29T22:27:29.811ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-02-29T22:27:29.813ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-791562f7-d4c3-48d2-ae65-0e8d83f43dd6
572024-02-29T22:27:29.820ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-791562f7-d4c3-48d2-ae65-0e8d83f43dd6
582024-02-29T22:27:29.838ZINFOcrucible-agent (worker): creating config property group
592024-02-29T22:27:29.848ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-791562f7-d4c3-48d2-ae65-0e8d83f43dd6
602024-02-29T22:27:29.848ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/791562f7-d4c3-48d2-ae65-0e8d83f43dd6
612024-02-29T22:27:29.848ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-02-29T22:27:29.849ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
632024-02-29T22:27:29.849ZINFOcrucible-agent (worker): commit
642024-02-29T22:27:29.854ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58676 req_id = 7d06b848-b169-4ad8-9342-8fd365e653bb response_code = 200 uri = /crucible/0/regions
652024-02-29T22:27:29.856ZINFOcrucible-agent (worker): ok!
662024-02-29T22:27:29.864ZINFOcrucible-agent (worker): SMF ok!