Max level shown:
1 [ Mar 26 14:48:04 Enabled. ]
2 [ Mar 26 14:48:04 Rereading configuration. ]
3 [ Mar 26 14:48:06 Rereading configuration. ]
4 [ Mar 26 14:48:09 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-26T14:48:09.480ZINFOcrucible-agent: dataset: "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible"
72024-03-26T14:48:09.484ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82024-03-26T14:48:09.484ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-26T14:48:09.696ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
102024-03-26T14:48:52.704ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:43935
112024-03-26T14:48:52.748ZINFOcrucible-agent (datafile): region dbc55938-4211-4fe9-a54d-444fdc0443a2 state: Requested
122024-03-26T14:48:52.750ZINFOcrucible-agent (dropshot): request completed latency_us = 14579 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43935 req_id = 039838cd-2435-42cd-825d-88c0a80a13d2 response_code = 200 uri = /crucible/0/regions
132024-03-26T14:48:52.751ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-03-26T14:48:52.761ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2
152024-03-26T14:48:52.761ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2
162024-03-26T14:48:52.823ZINFOcrucible-agent (worker): creating region Region { id: RegionId("dbc55938-4211-4fe9-a54d-444fdc0443a2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2" region = dbc55938-4211-4fe9-a54d-444fdc0443a2
172024-03-26T14:48:52.930ZINFOcrucible-agent (worker): region files created ok region = dbc55938-4211-4fe9-a54d-444fdc0443a2
182024-03-26T14:48:52.930ZINFOcrucible-agent (datafile): region dbc55938-4211-4fe9-a54d-444fdc0443a2 state: Requested -> Created
192024-03-26T14:48:52.930ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-03-26T14:48:52.931ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-dbc55938-4211-4fe9-a54d-444fdc0443a2
212024-03-26T14:48:52.933ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-dbc55938-4211-4fe9-a54d-444fdc0443a2
222024-03-26T14:48:52.947ZINFOcrucible-agent (worker): creating config property group
232024-03-26T14:48:52.949ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-dbc55938-4211-4fe9-a54d-444fdc0443a2
242024-03-26T14:48:52.950ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2
252024-03-26T14:48:52.950ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-03-26T14:48:52.950ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
272024-03-26T14:48:52.950ZINFOcrucible-agent (worker): commit
282024-03-26T14:48:52.955ZINFOcrucible-agent (worker): ok!
292024-03-26T14:48:52.965ZINFOcrucible-agent (worker): SMF ok!
302024-03-26T14:48:52.985ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43935 req_id = b2f38dd0-f9f0-4e21-bf9c-c197fa49c0ad response_code = 200 uri = /crucible/0/regions
312024-03-26T14:48:53.183ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:47266
322024-03-26T14:48:53.183ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:47266 req_id = 91eefafd-bce9-40ad-8f03-c8ce54bc3a27 response_code = 200 uri = /crucible/0/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2
332024-03-26T14:48:53.183ZINFOcrucible-agent (datafile): path is "/data/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2"
342024-03-26T14:48:53.192ZINFOcrucible-agent (datafile): dataset is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2
352024-03-26T14:48:53.200ZINFOcrucible-agent (datafile): region dbc55938-4211-4fe9-a54d-444fdc0443a2 state: Created -> Tombstoned
362024-03-26T14:48:53.201ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-03-26T14:48:53.201ZINFOcrucible-agent (dropshot): request completed latency_us = 17322 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:47266 req_id = 1d552995-b0b8-4813-aaf7-5b9a2bf182b2 response_code = 204 uri = /crucible/0/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2
382024-03-26T14:48:53.201ZINFOcrucible-agent (dropshot): request completed latency_us = 563 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:47266 req_id = 8e778428-9ce9-47ec-9298-9622e4abef8f response_code = 200 uri = /crucible/0/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2
392024-03-26T14:48:53.202ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-dbc55938-4211-4fe9-a54d-444fdc0443a2 (instance states: (Some(Online), None))
402024-03-26T14:48:53.206ZINFOcrucible-agent (worker): SMF ok!
412024-03-26T14:48:53.215ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2" region = dbc55938-4211-4fe9-a54d-444fdc0443a2
422024-03-26T14:48:53.266ZINFOcrucible-agent (datafile): region dbc55938-4211-4fe9-a54d-444fdc0443a2 state: Tombstoned -> Destroyed
432024-03-26T14:48:53.345ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:47266 req_id = a288d388-a6bf-435e-9e8c-aa2f1385ed04 response_code = 200 uri = /crucible/0/regions/dbc55938-4211-4fe9-a54d-444fdc0443a2
442024-03-26T14:54:42.047ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:36627
452024-03-26T14:54:42.076ZINFOcrucible-agent (datafile): region a29caa98-50eb-4fb5-96b7-f51fcd3a53ef state: Requested
462024-03-26T14:54:42.077ZINFOcrucible-agent (dropshot): request completed latency_us = 781 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36627 req_id = 1e9d40ee-c720-49b7-b593-c33bad314782 response_code = 200 uri = /crucible/0/regions
472024-03-26T14:54:42.077ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-03-26T14:54:42.087ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/a29caa98-50eb-4fb5-96b7-f51fcd3a53ef
492024-03-26T14:54:42.087ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/a29caa98-50eb-4fb5-96b7-f51fcd3a53ef
502024-03-26T14:54:42.145ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a29caa98-50eb-4fb5-96b7-f51fcd3a53ef"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/a29caa98-50eb-4fb5-96b7-f51fcd3a53ef" region = a29caa98-50eb-4fb5-96b7-f51fcd3a53ef
512024-03-26T14:54:42.366ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36627 req_id = 26465829-398a-4dcb-b22a-fc11dcf6b5ee response_code = 200 uri = /crucible/0/regions
522024-03-26T14:54:42.391ZINFOcrucible-agent (worker): region files created ok region = a29caa98-50eb-4fb5-96b7-f51fcd3a53ef
532024-03-26T14:54:42.391ZINFOcrucible-agent (datafile): region a29caa98-50eb-4fb5-96b7-f51fcd3a53ef state: Requested -> Created
542024-03-26T14:54:42.391ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-03-26T14:54:42.392ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a29caa98-50eb-4fb5-96b7-f51fcd3a53ef
562024-03-26T14:54:42.397ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a29caa98-50eb-4fb5-96b7-f51fcd3a53ef
572024-03-26T14:54:42.411ZINFOcrucible-agent (worker): creating config property group
582024-03-26T14:54:42.413ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a29caa98-50eb-4fb5-96b7-f51fcd3a53ef
592024-03-26T14:54:42.413ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a29caa98-50eb-4fb5-96b7-f51fcd3a53ef
602024-03-26T14:54:42.413ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-03-26T14:54:42.413ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
622024-03-26T14:54:42.414ZINFOcrucible-agent (worker): commit
632024-03-26T14:54:42.417ZINFOcrucible-agent (worker): ok!
642024-03-26T14:54:42.421ZINFOcrucible-agent (worker): SMF ok!
652024-03-26T14:54:43.058ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36627 req_id = e85c0b73-ce77-4a7c-ab52-6e12dbb803d1 response_code = 200 uri = /crucible/0/regions