Max level shown:
1 [ May 8 02:58:39 Enabled. ]
2 [ May 8 02:58:39 Rereading configuration. ]
3 [ May 8 02:58:40 Rereading configuration. ]
4 [ May 8 02:58:41 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ May 8 02:58:41 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-05-08T02:58:41.446ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-05-08T02:58:41.446ZINFOdns-server (store): opening sled database path = /data/dns
102026-05-08T02:58:41.468ZINFOdns-server (store): pruning trees for generations newer than 0
112026-05-08T02:58:41.468ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-05-08T02:58:41.468ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-05-08T02:58:41.468ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-05-08T02:58:42.660ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:33320
152026-05-08T02:58:42.661ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 9ace268b-9c7a-4bb4-9e9c-e2aa02670234
162026-05-08T02:58:42.661ZINFOdns-server (store): pruning trees for generations newer than 0
172026-05-08T02:58:42.673ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-05-08T02:58:42.673ZINFOdns-server (store): updated generation new_generation = 1 req_id = 9ace268b-9c7a-4bb4-9e9c-e2aa02670234
192026-05-08T02:58:42.673ZINFOdns-server (http): request completed latency_us = 12180 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:33320 req_id = 9ace268b-9c7a-4bb4-9e9c-e2aa02670234 response_code = 204 uri = /config
202026-05-08T02:58:53.536ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24338, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:49502 req_id = dd1da895-4d4a-4ffd-8057-6a98f4b66db8
212026-05-08T02:58:53.540ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 6357, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35539 req_id = ecdaed68-eed9-49c8-bdc3-0ae59a012ab2
222026-05-08T02:58:53.545ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52469, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:48554 req_id = f3994ee2-f0e1-4e9e-ae4f-cc52d8445180
232026-05-08T03:00:00.134ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47716, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_109f168d-fa89-4398-8bd5-ff9fae0d5ef6."), ), original: Query { name: Name("oxz_cockroachdb_109f168d-fa89-4398-8bd5-ff9fae0d5ef6."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 48, 57, 102, 49, 54, 56, 100, 45, 102, 97, 56, 57, 45, 52, 51, 57, 56, 45, 56, 98, 100, 53, 45, 102, 102, 57, 102, 97, 101, 48, 100, 53, 101, 102, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_109f168d-fa89-4398-8bd5-ff9fae0d5ef6." peer_addr = [fd00:1122:3344:101::7]:63193 req_id = 7e6442e3-d1e5-4238-90ba-283ac5c68065
242026-05-08T03:00:00.135ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40774, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_973d1923-8553-4109-9520-b3162a20db0a."), ), original: Query { name: Name("oxz_cockroachdb_973d1923-8553-4109-9520-b3162a20db0a."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 55, 51, 100, 49, 57, 50, 51, 45, 56, 53, 53, 51, 45, 52, 49, 48, 57, 45, 57, 53, 50, 48, 45, 98, 51, 49, 54, 50, 97, 50, 48, 100, 98, 48, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_973d1923-8553-4109-9520-b3162a20db0a." peer_addr = [fd00:1122:3344:101::4]:65124 req_id = c00425c0-9f1e-4a34-8859-cc9505336609
252026-05-08T03:00:00.136ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61005, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_801dd7e0-e97e-40af-8334-9436447575d0."), ), original: Query { name: Name("oxz_cockroachdb_801dd7e0-e97e-40af-8334-9436447575d0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 48, 49, 100, 100, 55, 101, 48, 45, 101, 57, 55, 101, 45, 52, 48, 97, 102, 45, 56, 51, 51, 52, 45, 57, 52, 51, 54, 52, 52, 55, 53, 55, 53, 100, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_801dd7e0-e97e-40af-8334-9436447575d0." peer_addr = [fd00:1122:3344:101::3]:54681 req_id = ccce6dc4-b46f-4862-a868-559e5c142ab2
262026-05-08T03:00:00.148ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61005, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_801dd7e0-e97e-40af-8334-9436447575d0."), ), original: Query { name: Name("oxz_cockroachdb_801dd7e0-e97e-40af-8334-9436447575d0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 48, 49, 100, 100, 55, 101, 48, 45, 101, 57, 55, 101, 45, 52, 48, 97, 102, 45, 56, 51, 51, 52, 45, 57, 52, 51, 54, 52, 52, 55, 53, 55, 53, 100, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_801dd7e0-e97e-40af-8334-9436447575d0." peer_addr = [fd00:1122:3344:101::3]:56704 req_id = 25702e4e-d5a0-48d0-867a-3e04d2d75e80
272026-05-08T03:00:00.148ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 47716, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_109f168d-fa89-4398-8bd5-ff9fae0d5ef6."), ), original: Query { name: Name("oxz_cockroachdb_109f168d-fa89-4398-8bd5-ff9fae0d5ef6."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 49, 48, 57, 102, 49, 54, 56, 100, 45, 102, 97, 56, 57, 45, 52, 51, 57, 56, 45, 56, 98, 100, 53, 45, 102, 102, 57, 102, 97, 101, 48, 100, 53, 101, 102, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_109f168d-fa89-4398-8bd5-ff9fae0d5ef6." peer_addr = [fd00:1122:3344:101::7]:48592 req_id = eb884ffc-7818-4f8d-8341-03f410d3a741
282026-05-08T03:00:00.150ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40774, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_973d1923-8553-4109-9520-b3162a20db0a."), ), original: Query { name: Name("oxz_cockroachdb_973d1923-8553-4109-9520-b3162a20db0a."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 55, 51, 100, 49, 57, 50, 51, 45, 56, 53, 53, 51, 45, 52, 49, 48, 57, 45, 57, 53, 50, 48, 45, 98, 51, 49, 54, 50, 97, 50, 48, 100, 98, 48, 97, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_973d1923-8553-4109-9520-b3162a20db0a." peer_addr = [fd00:1122:3344:101::4]:60717 req_id = ba7cec3e-ec02-4b33-90eb-9589a9223685
292026-05-08T03:00:00.180ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27921, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7db3001d-fb14-4e44-b453-8acf6ca804c0."), ), original: Query { name: Name("oxz_cockroachdb_7db3001d-fb14-4e44-b453-8acf6ca804c0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 100, 98, 51, 48, 48, 49, 100, 45, 102, 98, 49, 52, 45, 52, 101, 52, 52, 45, 98, 52, 53, 51, 45, 56, 97, 99, 102, 54, 99, 97, 56, 48, 52, 99, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7db3001d-fb14-4e44-b453-8acf6ca804c0." peer_addr = [fd00:1122:3344:101::5]:42131 req_id = cb00624e-da3f-4793-a5de-55bf8128bf51
302026-05-08T03:00:00.185ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27921, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7db3001d-fb14-4e44-b453-8acf6ca804c0."), ), original: Query { name: Name("oxz_cockroachdb_7db3001d-fb14-4e44-b453-8acf6ca804c0."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 100, 98, 51, 48, 48, 49, 100, 45, 102, 98, 49, 52, 45, 52, 101, 52, 52, 45, 98, 52, 53, 51, 45, 56, 97, 99, 102, 54, 99, 97, 56, 48, 52, 99, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7db3001d-fb14-4e44-b453-8acf6ca804c0." peer_addr = [fd00:1122:3344:101::5]:57104 req_id = b8bf2bc3-d68e-4e80-85f3-a3fcd4ddb470
312026-05-08T03:00:00.858ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41572, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5580f08e-a554-474f-86c7-d84e9ba44d9f."), ), original: Query { name: Name("oxz_cockroachdb_5580f08e-a554-474f-86c7-d84e9ba44d9f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 53, 56, 48, 102, 48, 56, 101, 45, 97, 53, 53, 52, 45, 52, 55, 52, 102, 45, 56, 54, 99, 55, 45, 100, 56, 52, 101, 57, 98, 97, 52, 52, 100, 57, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5580f08e-a554-474f-86c7-d84e9ba44d9f." peer_addr = [fd00:1122:3344:101::6]:41904 req_id = c1922fa8-7bb8-47ff-a3ca-f1c4b96b08fb
322026-05-08T03:00:00.860ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41572, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_5580f08e-a554-474f-86c7-d84e9ba44d9f."), ), original: Query { name: Name("oxz_cockroachdb_5580f08e-a554-474f-86c7-d84e9ba44d9f."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 53, 56, 48, 102, 48, 56, 101, 45, 97, 53, 53, 52, 45, 52, 55, 52, 102, 45, 56, 54, 99, 55, 45, 100, 56, 52, 101, 57, 98, 97, 52, 52, 100, 57, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_5580f08e-a554-474f-86c7-d84e9ba44d9f." peer_addr = [fd00:1122:3344:101::6]:50944 req_id = 056a2a36-0051-4861-a6d6-1fa4ee52b02f
332026-05-08T03:00:00.903ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44351, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_00830540-68b0-4359-b37f-8e9086b7b7fd."), ), original: Query { name: Name("oxz_ntp_00830540-68b0-4359-b37f-8e9086b7b7fd."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 48, 48, 56, 51, 48, 53, 52, 48, 45, 54, 56, 98, 48, 45, 52, 51, 53, 57, 45, 98, 51, 55, 102, 45, 56, 101, 57, 48, 56, 54, 98, 55, 98, 55, 102, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_00830540-68b0-4359-b37f-8e9086b7b7fd." peer_addr = [fd00:1122:3344:101::1b]:65428 req_id = 77279629-174f-45ce-a58e-26dcf78a6151
342026-05-08T03:00:01.103ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45810, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:53105 req_id = 9476cb94-baf2-41ae-aa4a-90c67129df87
352026-05-08T03:00:01.104ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45810, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:32801 req_id = 935e0ca2-6f89-4fba-b510-a9cb230db02c