Max level shown:
1 [ Aug 29 03:28:26 Enabled. ]
2 [ Aug 29 03:28:26 Rereading configuration. ]
3 [ Aug 29 03:28:26 Rereading configuration. ]
4 [ Aug 29 03:28:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:1::1]:5353 --dns-address [fd00:1122:3344:1::1]:53 &"). ]
5 [ Aug 29 03:28:27 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-08-29T03:28:27.792ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:1::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:1::1]:53 }
92026-08-29T03:28:27.792ZINFOdns-server (store): opening sled database path = /data/dns
102026-08-29T03:28:27.814ZINFOdns-server (store): pruning trees for generations newer than 0
112026-08-29T03:28:27.814ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-08-29T03:28:27.814ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:1::1]:53
132026-08-29T03:28:27.814ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:1::1]:5353
142026-08-29T03:28:28.133ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:1::1]:5353 remote_addr = [fd00:1122:3344:1::2]:62950
152026-08-29T03:28:28.134ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 3afb5644-933d-48f5-bf96-b1f3a8590dc0
162026-08-29T03:28:28.134ZINFOdns-server (store): pruning trees for generations newer than 0
172026-08-29T03:28:28.146ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-08-29T03:28:28.146ZINFOdns-server (store): updated generation new_generation = 1 req_id = 3afb5644-933d-48f5-bf96-b1f3a8590dc0
192026-08-29T03:28:28.146ZINFOdns-server (http): request completed latency_us = 13155 local_addr = [fd00:1122:3344:1::1]:5353 method = PUT remote_addr = [fd00:1122:3344:1::2]:62950 req_id = 3afb5644-933d-48f5-bf96-b1f3a8590dc0 response_code = 204 uri = /config
202026-08-29T03:28:39.715ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 23310, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:60195 req_id = a0c4da63-5d1a-4be2-b060-ce5494679bdd
212026-08-29T03:28:39.720ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48205, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:50719 req_id = 59bdd902-bfaf-4e1d-920c-004df764e397
222026-08-29T03:28:39.724ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33968, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:49410 req_id = d67e5a8f-59d0-4c76-8455-5499e4782671
232026-08-29T03:30:00.283ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7015, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:50711 req_id = 227c6edf-e72a-4647-a880-27ba3b03012c
242026-08-29T03:30:00.292ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48615, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_d3b93d3a-deb8-4bfe-8c06-2c7e6f9dd0a7."), ), original: Query { name: Name("oxz_ntp_d3b93d3a-deb8-4bfe-8c06-2c7e6f9dd0a7."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 100, 51, 98, 57, 51, 100, 51, 97, 45, 100, 101, 98, 56, 45, 52, 98, 102, 101, 45, 56, 99, 48, 54, 45, 50, 99, 55, 101, 54, 102, 57, 100, 100, 48, 97, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_d3b93d3a-deb8-4bfe-8c06-2c7e6f9dd0a7." peer_addr = [fd00:1122:3344:101::1b]:49424 req_id = ca567dc3-1c45-4af1-acc2-e8d7e7cce6eb
252026-08-29T03:30:00.297ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7015, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:59066 req_id = 2acf0bee-01e1-479e-b98a-3826e84f99f0
262026-08-29T03:30:00.476ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41883, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e2b3204e-f599-493e-a476-350388698859."), ), original: Query { name: Name("oxz_cockroachdb_e2b3204e-f599-493e-a476-350388698859."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 50, 98, 51, 50, 48, 52, 101, 45, 102, 53, 57, 57, 45, 52, 57, 51, 101, 45, 97, 52, 55, 54, 45, 51, 53, 48, 51, 56, 56, 54, 57, 56, 56, 53, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e2b3204e-f599-493e-a476-350388698859." peer_addr = [fd00:1122:3344:101::6]:61414 req_id = e240dec8-75f2-42cf-9229-3e55e8e0fd52
272026-08-29T03:30:00.477ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41883, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e2b3204e-f599-493e-a476-350388698859."), ), original: Query { name: Name("oxz_cockroachdb_e2b3204e-f599-493e-a476-350388698859."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 50, 98, 51, 50, 48, 52, 101, 45, 102, 53, 57, 57, 45, 52, 57, 51, 101, 45, 97, 52, 55, 54, 45, 51, 53, 48, 51, 56, 56, 54, 57, 56, 56, 53, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e2b3204e-f599-493e-a476-350388698859." peer_addr = [fd00:1122:3344:101::6]:56403 req_id = 1e67579f-5163-4fa6-ad62-4d9bd97b8075
282026-08-29T03:30:00.525ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36251, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ecfc18f4-b550-44ea-b806-bde8728ec325."), ), original: Query { name: Name("oxz_cockroachdb_ecfc18f4-b550-44ea-b806-bde8728ec325."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 99, 102, 99, 49, 56, 102, 52, 45, 98, 53, 53, 48, 45, 52, 52, 101, 97, 45, 98, 56, 48, 54, 45, 98, 100, 101, 56, 55, 50, 56, 101, 99, 51, 50, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ecfc18f4-b550-44ea-b806-bde8728ec325." peer_addr = [fd00:1122:3344:101::4]:41649 req_id = c9478c22-87a1-41bc-a631-1b8e9b9bba9e
292026-08-29T03:30:00.526ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35884, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_522fbecb-4717-4063-98b7-3b61c2ddce27."), ), original: Query { name: Name("oxz_cockroachdb_522fbecb-4717-4063-98b7-3b61c2ddce27."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 50, 50, 102, 98, 101, 99, 98, 45, 52, 55, 49, 55, 45, 52, 48, 54, 51, 45, 57, 56, 98, 55, 45, 51, 98, 54, 49, 99, 50, 100, 100, 99, 101, 50, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_522fbecb-4717-4063-98b7-3b61c2ddce27." peer_addr = [fd00:1122:3344:101::7]:54846 req_id = d03dee83-5c99-44d6-96a5-2e78d51a5b71
302026-08-29T03:30:00.526ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 36251, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ecfc18f4-b550-44ea-b806-bde8728ec325."), ), original: Query { name: Name("oxz_cockroachdb_ecfc18f4-b550-44ea-b806-bde8728ec325."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 99, 102, 99, 49, 56, 102, 52, 45, 98, 53, 53, 48, 45, 52, 52, 101, 97, 45, 98, 56, 48, 54, 45, 98, 100, 101, 56, 55, 50, 56, 101, 99, 51, 50, 53, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ecfc18f4-b550-44ea-b806-bde8728ec325." peer_addr = [fd00:1122:3344:101::4]:53369 req_id = 91cdd45e-6a54-4469-8040-b8e28a2513e2
312026-08-29T03:30:00.527ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35884, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_522fbecb-4717-4063-98b7-3b61c2ddce27."), ), original: Query { name: Name("oxz_cockroachdb_522fbecb-4717-4063-98b7-3b61c2ddce27."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 50, 50, 102, 98, 101, 99, 98, 45, 52, 55, 49, 55, 45, 52, 48, 54, 51, 45, 57, 56, 98, 55, 45, 51, 98, 54, 49, 99, 50, 100, 100, 99, 101, 50, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_522fbecb-4717-4063-98b7-3b61c2ddce27." peer_addr = [fd00:1122:3344:101::7]:36171 req_id = a5dd21b1-4b24-4a6f-ab87-7c6c3b461561
322026-08-29T03:30:00.540ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39899, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_709577ad-a3f5-4f71-b068-8187203bdcdc."), ), original: Query { name: Name("oxz_cockroachdb_709577ad-a3f5-4f71-b068-8187203bdcdc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 48, 57, 53, 55, 55, 97, 100, 45, 97, 51, 102, 53, 45, 52, 102, 55, 49, 45, 98, 48, 54, 56, 45, 56, 49, 56, 55, 50, 48, 51, 98, 100, 99, 100, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_709577ad-a3f5-4f71-b068-8187203bdcdc." peer_addr = [fd00:1122:3344:101::5]:42878 req_id = 5e582a9c-4cf0-4f41-8ac9-c570eca34e14
332026-08-29T03:30:00.540ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 39899, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_709577ad-a3f5-4f71-b068-8187203bdcdc."), ), original: Query { name: Name("oxz_cockroachdb_709577ad-a3f5-4f71-b068-8187203bdcdc."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 48, 57, 53, 55, 55, 97, 100, 45, 97, 51, 102, 53, 45, 52, 102, 55, 49, 45, 98, 48, 54, 56, 45, 56, 49, 56, 55, 50, 48, 51, 98, 100, 99, 100, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_709577ad-a3f5-4f71-b068-8187203bdcdc." peer_addr = [fd00:1122:3344:101::5]:54414 req_id = f8a26c2a-7878-4d4d-bf4d-03849d2310eb
342026-08-29T03:30:00.549ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35197, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_887969df-74ea-410c-a1cb-a850a2d7bf5e."), ), original: Query { name: Name("oxz_cockroachdb_887969df-74ea-410c-a1cb-a850a2d7bf5e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 55, 57, 54, 57, 100, 102, 45, 55, 52, 101, 97, 45, 52, 49, 48, 99, 45, 97, 49, 99, 98, 45, 97, 56, 53, 48, 97, 50, 100, 55, 98, 102, 53, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_887969df-74ea-410c-a1cb-a850a2d7bf5e." peer_addr = [fd00:1122:3344:101::3]:55244 req_id = 03cf1f57-6139-4882-97a5-224a633b24be
352026-08-29T03:30:00.550ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35197, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_887969df-74ea-410c-a1cb-a850a2d7bf5e."), ), original: Query { name: Name("oxz_cockroachdb_887969df-74ea-410c-a1cb-a850a2d7bf5e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 55, 57, 54, 57, 100, 102, 45, 55, 52, 101, 97, 45, 52, 49, 48, 99, 45, 97, 49, 99, 98, 45, 97, 56, 53, 48, 97, 50, 100, 55, 98, 102, 53, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_887969df-74ea-410c-a1cb-a850a2d7bf5e." peer_addr = [fd00:1122:3344:101::3]:42064 req_id = 92e57658-9f83-461a-9685-b618b8ff5250