Max level shown:
1 [ Jan 24 19:33:25 Enabled. ]
2 [ Jan 24 19:33:25 Rereading configuration. ]
3 [ Jan 24 19:33:28 Rereading configuration. ]
4 [ Jan 24 19:33:35 Executing start method ("/opt/oxide/lib/svc/manifest/crucible/agent.sh"). ]
5 + . /lib/svc/share/smf_include.sh
6 ++ SMF_EXIT_OK=0
7 ++ SMF_EXIT_NODAEMON=94
8 ++ SMF_EXIT_ERR_FATAL=95
9 ++ SMF_EXIT_ERR_CONFIG=96
10 ++ SMF_EXIT_MON_DEGRADE=97
11 ++ SMF_EXIT_MON_OFFLINE=98
12 ++ SMF_EXIT_ERR_NOSMF=99
13 ++ SMF_EXIT_ERR_PERM=100
14 ++ svcprop -c -p config/datalink svc:/oxide/crucible/agent:default
15 + DATALINK=oxControlService18
16 ++ svcprop -c -p config/gateway svc:/oxide/crucible/agent:default
17 + GATEWAY=fd00:1122:3344:101::1
18 ++ svcprop -c -p config/dataset svc:/oxide/crucible/agent:default
19 + DATASET=oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible
20 ++ svcprop -c -p config/listen_addr svc:/oxide/crucible/agent:default
21 + LISTEN_ADDR=fd00:1122:3344:101::17
22 ++ svcprop -c -p config/listen_port svc:/oxide/crucible/agent:default
23 + LISTEN_PORT=32345
24 ++ svcprop -c -p config/portbase svc:/oxide/crucible/agent:default
25 + PORTBASE=19000
26 ++ svcprop -c -p config/downstairs_prefix svc:/oxide/crucible/agent:default
27 + DOWNSTAIRS_PREFIX=downstairs
28 ++ svcprop -c -p config/snapshot_prefix svc:/oxide/crucible/agent:default
29 + SNAPSHOT_PREFIX=snapshot
30 + [[ oxControlService18 == unknown ]]
31 + [[ fd00:1122:3344:101::1 == unknown ]]
32 + ipadm delete-if oxControlService18
33 ipadm: Could not delete oxControlService18: Interface does not exist
34 + true
35 + ipadm create-if -t oxControlService18
36 + ipadm set-ifprop -t -p mtu=9000 -m ipv4 oxControlService18
37 + ipadm set-ifprop -t -p mtu=9000 -m ipv6 oxControlService18
38 + ipadm show-addr oxControlService18/ll
39 ipadm: Address object not found
40 + ipadm create-addr -t -T addrconf oxControlService18/ll
41 + ipadm show-addr oxControlService18/omicron6
42 ipadm: Address object not found
43 + ipadm create-addr -t -T static -a fd00:1122:3344:101::17 oxControlService18/omicron6
44 + route get -inet6 default -inet6 fd00:1122:3344:101::1
45 default: not in table
46 + route add -inet6 default -inet6 fd00:1122:3344:101::1
47 add net default: gateway fd00:1122:3344:101::1
48 + args=('-D' '/opt/oxide/crucible/bin/crucible-downstairs' '--dataset' "$DATASET" '-l' "[$LISTEN_ADDR]:$LISTEN_PORT" '-P' "$PORTBASE" '-p' "$DOWNSTAIRS_PREFIX" '-s' "$SNAPSHOT_PREFIX")
49 + exec /opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible -l '[fd00:1122:3344:101::17]:32345' -P 19000 -p downstairs -s snapshot
50 note: configured to log to "/dev/stdout"
512024-01-24T19:33:36.394ZINFOcrucible-agent: dataset: "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible"
522024-01-24T19:33:36.397ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
532024-01-24T19:33:36.397ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
542024-01-24T19:33:36.560ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
552024-01-24T19:34:29.231ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:41569
562024-01-24T19:34:29.259ZINFOcrucible-agent (datafile): region 04311c2b-9975-4f31-89b2-39ed4a6bbeae state: Requested
572024-01-24T19:34:29.265ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
582024-01-24T19:34:29.265ZINFOcrucible-agent (dropshot): request completed latency_us = 15575 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41569 req_id = d97cd39e-52a0-4b0b-8914-7b5a64bd30dc response_code = 200 uri = /crucible/0/regions
592024-01-24T19:34:29.274ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae
602024-01-24T19:34:29.274ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae
612024-01-24T19:34:29.324ZINFOcrucible-agent (worker): creating region Region { id: RegionId("04311c2b-9975-4f31-89b2-39ed4a6bbeae"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae" region = 04311c2b-9975-4f31-89b2-39ed4a6bbeae
622024-01-24T19:34:29.399ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41569 req_id = 3d8a83d4-f177-41f2-9329-52a9eb6f40cc response_code = 200 uri = /crucible/0/regions
632024-01-24T19:34:29.638ZINFOcrucible-agent (worker): region files created ok region = 04311c2b-9975-4f31-89b2-39ed4a6bbeae
642024-01-24T19:34:29.638ZINFOcrucible-agent (datafile): region 04311c2b-9975-4f31-89b2-39ed4a6bbeae state: Requested -> Created
652024-01-24T19:34:29.638ZINFOcrucible-agent (worker): applying SMF actions post create...
662024-01-24T19:34:29.641ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-04311c2b-9975-4f31-89b2-39ed4a6bbeae
672024-01-24T19:34:29.646ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-04311c2b-9975-4f31-89b2-39ed4a6bbeae
682024-01-24T19:34:29.656ZINFOcrucible-agent (worker): creating config property group
692024-01-24T19:34:29.660ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-04311c2b-9975-4f31-89b2-39ed4a6bbeae
702024-01-24T19:34:29.661ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae
712024-01-24T19:34:29.663ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
722024-01-24T19:34:29.663ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
732024-01-24T19:34:29.663ZINFOcrucible-agent (worker): commit
742024-01-24T19:34:29.671ZINFOcrucible-agent (worker): ok!
752024-01-24T19:34:29.677ZINFOcrucible-agent (worker): SMF ok!
762024-01-24T19:34:29.791ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41569 req_id = 41992060-1814-4c84-b259-d3e38b55e2b7 response_code = 200 uri = /crucible/0/regions
772024-01-24T19:34:30.095ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:52606
782024-01-24T19:34:30.095ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52606 req_id = 93a84285-3fd7-4c0c-a390-e209068e1329 response_code = 200 uri = /crucible/0/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae
792024-01-24T19:34:30.095ZINFOcrucible-agent (datafile): path is "/data/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae"
802024-01-24T19:34:30.106ZINFOcrucible-agent (datafile): dataset is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae
812024-01-24T19:34:30.116ZINFOcrucible-agent (datafile): region 04311c2b-9975-4f31-89b2-39ed4a6bbeae state: Created -> Tombstoned
822024-01-24T19:34:30.116ZINFOcrucible-agent (worker): applying SMF actions before removal...
832024-01-24T19:34:30.116ZINFOcrucible-agent (dropshot): request completed latency_us = 20568 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:52606 req_id = 20bdc7e1-f92c-493f-aba1-2ff20a27b661 response_code = 204 uri = /crucible/0/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae
842024-01-24T19:34:30.116ZINFOcrucible-agent (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52606 req_id = 62bf5150-9b2d-47ee-9fed-b77314cf10e0 response_code = 200 uri = /crucible/0/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae
852024-01-24T19:34:30.117ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-04311c2b-9975-4f31-89b2-39ed4a6bbeae (instance states: (Some(Online), None))
862024-01-24T19:34:30.126ZINFOcrucible-agent (worker): SMF ok!
872024-01-24T19:34:30.136ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae" region = 04311c2b-9975-4f31-89b2-39ed4a6bbeae
882024-01-24T19:34:30.197ZINFOcrucible-agent (datafile): region 04311c2b-9975-4f31-89b2-39ed4a6bbeae state: Tombstoned -> Destroyed
892024-01-24T19:34:30.202ZINFOcrucible-agent (dropshot): request completed latency_us = 547 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52606 req_id = 8108f30d-15ce-4eb6-9afa-2af651b63d87 response_code = 200 uri = /crucible/0/regions/04311c2b-9975-4f31-89b2-39ed4a6bbeae
902024-01-24T19:34:31.805ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:62341
912024-01-24T19:34:31.806ZINFOcrucible-agent (datafile): region f21ca891-3ef6-4fa0-ab10-6b831a573f45 state: Requested
922024-01-24T19:34:31.806ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
932024-01-24T19:34:31.806ZINFOcrucible-agent (dropshot): request completed latency_us = 1101 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62341 req_id = ca322ff3-d353-439e-b394-20c238238b53 response_code = 200 uri = /crucible/0/regions
942024-01-24T19:34:31.816ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45
952024-01-24T19:34:31.816ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45
962024-01-24T19:34:31.865ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f21ca891-3ef6-4fa0-ab10-6b831a573f45"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45" region = f21ca891-3ef6-4fa0-ab10-6b831a573f45
972024-01-24T19:34:31.941ZINFOcrucible-agent (worker): region files created ok region = f21ca891-3ef6-4fa0-ab10-6b831a573f45
982024-01-24T19:34:31.942ZINFOcrucible-agent (datafile): region f21ca891-3ef6-4fa0-ab10-6b831a573f45 state: Requested -> Created
992024-01-24T19:34:31.942ZINFOcrucible-agent (worker): applying SMF actions post create...
1002024-01-24T19:34:31.942ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f21ca891-3ef6-4fa0-ab10-6b831a573f45
1012024-01-24T19:34:31.946ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f21ca891-3ef6-4fa0-ab10-6b831a573f45
1022024-01-24T19:34:31.955ZINFOcrucible-agent (worker): creating config property group
1032024-01-24T19:34:31.959ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f21ca891-3ef6-4fa0-ab10-6b831a573f45
1042024-01-24T19:34:31.959ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45
1052024-01-24T19:34:31.959ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1062024-01-24T19:34:31.959ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
1072024-01-24T19:34:31.959ZINFOcrucible-agent (worker): commit
1082024-01-24T19:34:31.963ZINFOcrucible-agent (worker): ok!
1092024-01-24T19:34:31.968ZINFOcrucible-agent (worker): SMF ok!
1102024-01-24T19:34:32.154ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62341 req_id = d519e223-bab8-4aaa-a627-9f4961418278 response_code = 200 uri = /crucible/0/regions
1112024-01-24T19:39:50.676ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:33729
1122024-01-24T19:39:50.676ZINFOcrucible-agent (datafile): region 1d06710b-3550-4c4e-8c41-eb2e8dbc20cd state: Requested
1132024-01-24T19:39:50.677ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1142024-01-24T19:39:50.677ZINFOcrucible-agent (dropshot): request completed latency_us = 820 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33729 req_id = 9e08f1ba-83af-4674-8b82-bd93cfaae35a response_code = 200 uri = /crucible/0/regions
1152024-01-24T19:39:50.686ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/1d06710b-3550-4c4e-8c41-eb2e8dbc20cd
1162024-01-24T19:39:50.686ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/1d06710b-3550-4c4e-8c41-eb2e8dbc20cd
1172024-01-24T19:39:50.748ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1d06710b-3550-4c4e-8c41-eb2e8dbc20cd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/1d06710b-3550-4c4e-8c41-eb2e8dbc20cd" region = 1d06710b-3550-4c4e-8c41-eb2e8dbc20cd
1182024-01-24T19:39:50.913ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33729 req_id = f9905a74-40db-4948-a885-b574776d281f response_code = 200 uri = /crucible/0/regions
1192024-01-24T19:39:50.937ZINFOcrucible-agent (worker): region files created ok region = 1d06710b-3550-4c4e-8c41-eb2e8dbc20cd
1202024-01-24T19:39:50.937ZINFOcrucible-agent (datafile): region 1d06710b-3550-4c4e-8c41-eb2e8dbc20cd state: Requested -> Created
1212024-01-24T19:39:50.937ZINFOcrucible-agent (worker): applying SMF actions post create...
1222024-01-24T19:39:50.938ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1d06710b-3550-4c4e-8c41-eb2e8dbc20cd
1232024-01-24T19:39:50.948ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1d06710b-3550-4c4e-8c41-eb2e8dbc20cd
1242024-01-24T19:39:50.970ZINFOcrucible-agent (worker): creating config property group
1252024-01-24T19:39:50.978ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1d06710b-3550-4c4e-8c41-eb2e8dbc20cd
1262024-01-24T19:39:50.979ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1d06710b-3550-4c4e-8c41-eb2e8dbc20cd
1272024-01-24T19:39:50.979ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
1282024-01-24T19:39:50.979ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
1292024-01-24T19:39:50.979ZINFOcrucible-agent (worker): commit
1302024-01-24T19:39:50.987ZINFOcrucible-agent (worker): ok!
1312024-01-24T19:39:50.999ZINFOcrucible-agent (worker): SMF ok!
1322024-01-24T19:39:51.307ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33729 req_id = d2b80bed-f974-4089-bf3d-e50e3bdc98bc response_code = 200 uri = /crucible/0/regions
1332024-01-24T19:39:52.093ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:54859
1342024-01-24T19:39:52.093ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54859 req_id = b14b70e9-c170-40ab-b82c-57f7fef2fcad response_code = 200 uri = /crucible/0/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45
1352024-01-24T19:39:52.093ZINFOcrucible-agent (datafile): path is "/data/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45"
1362024-01-24T19:39:52.102ZINFOcrucible-agent (datafile): dataset is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45
1372024-01-24T19:39:52.112ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45@a3b29d54-acfd-4978-bda5-b1397605fab9
1382024-01-24T19:39:52.112ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45", "a3b29d54-acfd-4978-bda5-b1397605fab9"]
1392024-01-24T19:39:52.123ZINFOcrucible-agent (dropshot): request completed latency_us = 30163 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54859 req_id = 462503fb-524d-417d-b373-12b712596794 response_code = 200 uri = /crucible/0/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45/snapshots/a3b29d54-acfd-4978-bda5-b1397605fab9
1402024-01-24T19:39:52.123ZINFOcrucible-agent (datafile): path is "/data/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45"
1412024-01-24T19:39:52.132ZINFOcrucible-agent (datafile): dataset is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45
1422024-01-24T19:39:52.141ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45@a3b29d54-acfd-4978-bda5-b1397605fab9
1432024-01-24T19:39:52.141ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45", "a3b29d54-acfd-4978-bda5-b1397605fab9"]
1442024-01-24T19:39:52.149ZINFOcrucible-agent (datafile): requesting running snapshot f21ca891-3ef6-4fa0-ab10-6b831a573f45-a3b29d54-acfd-4978-bda5-b1397605fab9 state: Requested
1452024-01-24T19:39:52.149ZINFOcrucible-agent (worker): applying SMF actions for region f21ca891-3ef6-4fa0-ab10-6b831a573f45 running snapshot a3b29d54-acfd-4978-bda5-b1397605fab9 (state Requested)...
1462024-01-24T19:39:52.149ZINFOcrucible-agent (dropshot): request completed latency_us = 26186 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54859 req_id = ec042dac-4141-4306-83e2-5a9e609b95fb response_code = 200 uri = /crucible/0/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45/snapshots/a3b29d54-acfd-4978-bda5-b1397605fab9/run
1472024-01-24T19:39:52.152ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-f21ca891-3ef6-4fa0-ab10-6b831a573f45-a3b29d54-acfd-4978-bda5-b1397605fab9
1482024-01-24T19:39:52.163ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-f21ca891-3ef6-4fa0-ab10-6b831a573f45-a3b29d54-acfd-4978-bda5-b1397605fab9
1492024-01-24T19:39:52.186ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-f21ca891-3ef6-4fa0-ab10-6b831a573f45-a3b29d54-acfd-4978-bda5-b1397605fab9
1502024-01-24T19:39:52.186ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f21ca891-3ef6-4fa0-ab10-6b831a573f45/.zfs/snapshot/a3b29d54-acfd-4978-bda5-b1397605fab9
1512024-01-24T19:39:52.186ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1522024-01-24T19:39:52.186ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
1532024-01-24T19:39:52.187ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
1542024-01-24T19:39:52.187ZINFOcrucible-agent (worker): commit
1552024-01-24T19:39:52.194ZINFOcrucible-agent (worker): ok!
1562024-01-24T19:39:52.201ZINFOcrucible-agent (worker): SMF ok!
1572024-01-24T19:39:52.201ZINFOcrucible-agent (datafile): region f21ca891-3ef6-4fa0-ab10-6b831a573f45 running snapshot a3b29d54-acfd-4978-bda5-b1397605fab9 state: Requested -> Created