Max level shown:
1 [ Sep 25 17:24:52 Enabled. ]
2 [ Sep 25 17:24:52 Rereading configuration. ]
3 [ Sep 25 17:24:54 Rereading configuration. ]
4 [ Sep 25 17:24:56 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-09-25T17:24:56.086ZINFOcrucible-agent: dataset: "oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible"
72024-09-25T17:24:56.093ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82024-09-25T17:24:56.093ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-09-25T17:24:56.116ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-09-25T17:24:56.256ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112024-09-25T17:25:47.712ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:40164
122024-09-25T17:25:47.743ZINFOcrucible-agent (datafile): region 61bf0519-b8ce-4779-a288-229bc72f426c state: Requested
132024-09-25T17:25:47.747ZINFOcrucible-agent (dropshot): request completed latency_us = 22236 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40164 req_id = c2d275fe-961d-43d2-abe0-b2e44f02266f response_code = 200 uri = /crucible/0/regions
142024-09-25T17:25:47.748ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-09-25T17:25:47.760ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/61bf0519-b8ce-4779-a288-229bc72f426c
162024-09-25T17:25:47.760ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/61bf0519-b8ce-4779-a288-229bc72f426c
172024-09-25T17:25:47.816ZINFOcrucible-agent (worker): creating region Region { id: RegionId("61bf0519-b8ce-4779-a288-229bc72f426c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/61bf0519-b8ce-4779-a288-229bc72f426c" region = 61bf0519-b8ce-4779-a288-229bc72f426c
182024-09-25T17:25:47.820ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "61bf0519-b8ce-4779-a288-229bc72f426c" "--data" "/data/regions/61bf0519-b8ce-4779-a288-229bc72f426c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 61bf0519-b8ce-4779-a288-229bc72f426c
192024-09-25T17:25:47.933ZINFOcrucible-agent (worker): region files created ok region = 61bf0519-b8ce-4779-a288-229bc72f426c
202024-09-25T17:25:47.933ZINFOcrucible-agent (datafile): region 61bf0519-b8ce-4779-a288-229bc72f426c state: Requested -> Created
212024-09-25T17:25:47.933ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-09-25T17:25:47.936ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-61bf0519-b8ce-4779-a288-229bc72f426c
232024-09-25T17:25:47.939ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-61bf0519-b8ce-4779-a288-229bc72f426c
242024-09-25T17:25:47.953ZINFOcrucible-agent (worker): creating config property group
252024-09-25T17:25:47.957ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-61bf0519-b8ce-4779-a288-229bc72f426c
262024-09-25T17:25:47.968ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/61bf0519-b8ce-4779-a288-229bc72f426c
272024-09-25T17:25:47.970ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-09-25T17:25:47.970ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
292024-09-25T17:25:47.970ZINFOcrucible-agent (worker): commit
302024-09-25T17:25:47.974ZINFOcrucible-agent (worker): ok!
312024-09-25T17:25:47.979ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40164 req_id = 8f6e90e6-5ab8-4087-9302-190e352fe69a response_code = 200 uri = /crucible/0/regions
322024-09-25T17:25:47.981ZINFOcrucible-agent (worker): SMF ok!
332024-09-25T17:25:48.815ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:40164 req_id = 6616c48a-dbf3-439c-816f-0c87be8be27a response_code = 200 uri = /crucible/0/regions/61bf0519-b8ce-4779-a288-229bc72f426c
342024-09-25T17:25:48.819ZINFOcrucible-agent (datafile): path is "/data/regions/61bf0519-b8ce-4779-a288-229bc72f426c"
352024-09-25T17:25:48.830ZINFOcrucible-agent (datafile): dataset is oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/61bf0519-b8ce-4779-a288-229bc72f426c
362024-09-25T17:25:48.840ZINFOcrucible-agent (datafile): region 61bf0519-b8ce-4779-a288-229bc72f426c state: Created -> Tombstoned
372024-09-25T17:25:48.840ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-09-25T17:25:48.840ZINFOcrucible-agent (dropshot): request completed latency_us = 20505 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:40164 req_id = ea1aff05-1706-49b8-be85-d45923fc1256 response_code = 204 uri = /crucible/0/regions/61bf0519-b8ce-4779-a288-229bc72f426c
392024-09-25T17:25:48.841ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-61bf0519-b8ce-4779-a288-229bc72f426c (instance states: (Some(Online), None))
402024-09-25T17:25:48.842ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:40164 req_id = 7a297a0f-34ef-499c-9d2a-a53b2117c65a response_code = 200 uri = /crucible/0/regions/61bf0519-b8ce-4779-a288-229bc72f426c
412024-09-25T17:25:48.845ZINFOcrucible-agent (worker): SMF ok!
422024-09-25T17:25:48.856ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/61bf0519-b8ce-4779-a288-229bc72f426c" region = 61bf0519-b8ce-4779-a288-229bc72f426c
432024-09-25T17:25:48.919ZINFOcrucible-agent (datafile): region 61bf0519-b8ce-4779-a288-229bc72f426c state: Tombstoned -> Destroyed
442024-09-25T17:25:48.986ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:40164 req_id = a64d0ff2-32ef-4b0e-8dd1-24d2a827fba6 response_code = 200 uri = /crucible/0/regions/61bf0519-b8ce-4779-a288-229bc72f426c
452024-09-25T17:26:23.292ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:65313
462024-09-25T17:26:23.292ZINFOcrucible-agent (datafile): region 786adca2-2581-4274-8ed6-21e58a33089b state: Requested
472024-09-25T17:26:23.292ZINFOcrucible-agent (dropshot): request completed latency_us = 209 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65313 req_id = 7de33e9f-4a15-4967-9ca3-c5552bd676ac response_code = 200 uri = /crucible/0/regions
482024-09-25T17:26:23.292ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-09-25T17:26:23.301ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b
502024-09-25T17:26:23.301ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b
512024-09-25T17:26:23.362ZINFOcrucible-agent (worker): creating region Region { id: RegionId("786adca2-2581-4274-8ed6-21e58a33089b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/786adca2-2581-4274-8ed6-21e58a33089b" region = 786adca2-2581-4274-8ed6-21e58a33089b
522024-09-25T17:26:23.364ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "786adca2-2581-4274-8ed6-21e58a33089b" "--data" "/data/regions/786adca2-2581-4274-8ed6-21e58a33089b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 786adca2-2581-4274-8ed6-21e58a33089b
532024-09-25T17:26:23.435ZINFOcrucible-agent (worker): region files created ok region = 786adca2-2581-4274-8ed6-21e58a33089b
542024-09-25T17:26:23.435ZINFOcrucible-agent (datafile): region 786adca2-2581-4274-8ed6-21e58a33089b state: Requested -> Created
552024-09-25T17:26:23.435ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-09-25T17:26:23.437ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-786adca2-2581-4274-8ed6-21e58a33089b
572024-09-25T17:26:23.441ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-786adca2-2581-4274-8ed6-21e58a33089b
582024-09-25T17:26:23.450ZINFOcrucible-agent (worker): creating config property group
592024-09-25T17:26:23.453ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-786adca2-2581-4274-8ed6-21e58a33089b
602024-09-25T17:26:23.453ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/786adca2-2581-4274-8ed6-21e58a33089b
612024-09-25T17:26:23.453ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-09-25T17:26:23.454ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
632024-09-25T17:26:23.454ZINFOcrucible-agent (worker): commit
642024-09-25T17:26:23.457ZINFOcrucible-agent (worker): ok!
652024-09-25T17:26:23.461ZINFOcrucible-agent (worker): SMF ok!
662024-09-25T17:26:23.514ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65313 req_id = 41d0a036-7b0c-42df-aceb-6b21ac187dab response_code = 200 uri = /crucible/0/regions