Max level shown:
1 [ Jul 22 16:12:48 Enabled. ]
2 [ Jul 22 16:12:48 Rereading configuration. ]
3 [ Jul 22 16:12:49 Rereading configuration. ]
4 [ Jul 22 16:12:50 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Jul 22 16:12:50 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-07-22T16:12:50.729ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-07-22T16:12:50.729ZINFOdns-server (store): opening sled database path = /data/dns
102026-07-22T16:12:50.751ZINFOdns-server (store): pruning trees for generations newer than 0
112026-07-22T16:12:50.751ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-07-22T16:12:50.751ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-07-22T16:12:50.751ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-07-22T16:12:51.350ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:43730
152026-07-22T16:12:51.351ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = e9d782c4-0b28-4c96-a869-bb48927e7174
162026-07-22T16:12:51.351ZINFOdns-server (store): pruning trees for generations newer than 0
172026-07-22T16:12:51.382ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-07-22T16:12:51.382ZINFOdns-server (store): updated generation new_generation = 1 req_id = e9d782c4-0b28-4c96-a869-bb48927e7174
192026-07-22T16:12:51.382ZINFOdns-server (http): request completed latency_us = 30832 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:43730 req_id = e9d782c4-0b28-4c96-a869-bb48927e7174 response_code = 204 uri = /config
202026-07-22T16:13:03.737ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 3854, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:46323 req_id = 62d1f25c-eb23-45ad-a748-752707624d78
212026-07-22T16:13:03.741ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 3055, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:45652 req_id = a77b8d72-cf72-43db-836c-deb780a0bb3c
222026-07-22T16:13:03.746ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 53126, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:43017 req_id = a485755a-9696-4050-b894-f999cea6bf67
232026-07-22T16:15:00.636ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49859, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2f83f542-31b9-4541-b822-d9f449d9d2ce."), ), original: Query { name: Name("oxz_cockroachdb_2f83f542-31b9-4541-b822-d9f449d9d2ce."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 102, 56, 51, 102, 53, 52, 50, 45, 51, 49, 98, 57, 45, 52, 53, 52, 49, 45, 98, 56, 50, 50, 45, 100, 57, 102, 52, 52, 57, 100, 57, 100, 50, 99, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2f83f542-31b9-4541-b822-d9f449d9d2ce." peer_addr = [fd00:1122:3344:101::6]:36654 req_id = a3cf559e-8601-475d-8d44-2ed6b711804e
242026-07-22T16:15:00.637ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 49859, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2f83f542-31b9-4541-b822-d9f449d9d2ce."), ), original: Query { name: Name("oxz_cockroachdb_2f83f542-31b9-4541-b822-d9f449d9d2ce."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 102, 56, 51, 102, 53, 52, 50, 45, 51, 49, 98, 57, 45, 52, 53, 52, 49, 45, 98, 56, 50, 50, 45, 100, 57, 102, 52, 52, 57, 100, 57, 100, 50, 99, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2f83f542-31b9-4541-b822-d9f449d9d2ce." peer_addr = [fd00:1122:3344:101::6]:63903 req_id = 683b8f57-5201-4ede-a754-1341dac949d8
252026-07-22T16:15:00.664ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18485, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_69ebd592-adfe-47af-a0aa-65fd4f1335b6."), ), original: Query { name: Name("oxz_cockroachdb_69ebd592-adfe-47af-a0aa-65fd4f1335b6."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 54, 57, 101, 98, 100, 53, 57, 50, 45, 97, 100, 102, 101, 45, 52, 55, 97, 102, 45, 97, 48, 97, 97, 45, 54, 53, 102, 100, 52, 102, 49, 51, 51, 53, 98, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_69ebd592-adfe-47af-a0aa-65fd4f1335b6." peer_addr = [fd00:1122:3344:101::4]:50540 req_id = 9a9536a7-6cda-4b6e-b27a-18e49da619c1
262026-07-22T16:15:00.664ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18485, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_69ebd592-adfe-47af-a0aa-65fd4f1335b6."), ), original: Query { name: Name("oxz_cockroachdb_69ebd592-adfe-47af-a0aa-65fd4f1335b6."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 54, 57, 101, 98, 100, 53, 57, 50, 45, 97, 100, 102, 101, 45, 52, 55, 97, 102, 45, 97, 48, 97, 97, 45, 54, 53, 102, 100, 52, 102, 49, 51, 51, 53, 98, 54, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_69ebd592-adfe-47af-a0aa-65fd4f1335b6." peer_addr = [fd00:1122:3344:101::4]:53729 req_id = 4477cbb7-156d-4de8-a0de-4f6474aede8d
272026-07-22T16:15:00.668ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29162, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_0a980b1e-278c-417e-83ce-d89d8c2e8453."), ), original: Query { name: Name("oxz_cockroachdb_0a980b1e-278c-417e-83ce-d89d8c2e8453."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 97, 57, 56, 48, 98, 49, 101, 45, 50, 55, 56, 99, 45, 52, 49, 55, 101, 45, 56, 51, 99, 101, 45, 100, 56, 57, 100, 56, 99, 50, 101, 56, 52, 53, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0a980b1e-278c-417e-83ce-d89d8c2e8453." peer_addr = [fd00:1122:3344:101::3]:43265 req_id = 57a6883a-c77c-4425-b1b9-59f457bc93dd
282026-07-22T16:15:00.668ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 29162, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_0a980b1e-278c-417e-83ce-d89d8c2e8453."), ), original: Query { name: Name("oxz_cockroachdb_0a980b1e-278c-417e-83ce-d89d8c2e8453."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 48, 97, 57, 56, 48, 98, 49, 101, 45, 50, 55, 56, 99, 45, 52, 49, 55, 101, 45, 56, 51, 99, 101, 45, 100, 56, 57, 100, 56, 99, 50, 101, 56, 52, 53, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_0a980b1e-278c-417e-83ce-d89d8c2e8453." peer_addr = [fd00:1122:3344:101::3]:64114 req_id = 65a71809-df45-4788-b45d-7cfaaf9d225c
292026-07-22T16:15:00.677ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7344, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_4d7b169e-07b8-4a62-aee2-18d4e14781e7."), ), original: Query { name: Name("oxz_cockroachdb_4d7b169e-07b8-4a62-aee2-18d4e14781e7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 100, 55, 98, 49, 54, 57, 101, 45, 48, 55, 98, 56, 45, 52, 97, 54, 50, 45, 97, 101, 101, 50, 45, 49, 56, 100, 52, 101, 49, 52, 55, 56, 49, 101, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_4d7b169e-07b8-4a62-aee2-18d4e14781e7." peer_addr = [fd00:1122:3344:101::5]:37725 req_id = d2a6abd2-9aa9-4814-a336-fd84c54cc333
302026-07-22T16:15:00.677ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7344, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_4d7b169e-07b8-4a62-aee2-18d4e14781e7."), ), original: Query { name: Name("oxz_cockroachdb_4d7b169e-07b8-4a62-aee2-18d4e14781e7."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 100, 55, 98, 49, 54, 57, 101, 45, 48, 55, 98, 56, 45, 52, 97, 54, 50, 45, 97, 101, 101, 50, 45, 49, 56, 100, 52, 101, 49, 52, 55, 56, 49, 101, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_4d7b169e-07b8-4a62-aee2-18d4e14781e7." peer_addr = [fd00:1122:3344:101::5]:34104 req_id = 61332b19-0991-467a-bdc9-b0ea5bb10aef
312026-07-22T16:15:00.686ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55254, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b74c3c1b-853b-4b96-a953-8d565451a8d4."), ), original: Query { name: Name("oxz_cockroachdb_b74c3c1b-853b-4b96-a953-8d565451a8d4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 55, 52, 99, 51, 99, 49, 98, 45, 56, 53, 51, 98, 45, 52, 98, 57, 54, 45, 97, 57, 53, 51, 45, 56, 100, 53, 54, 53, 52, 53, 49, 97, 56, 100, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b74c3c1b-853b-4b96-a953-8d565451a8d4." peer_addr = [fd00:1122:3344:101::7]:41518 req_id = 586d9a12-d2aa-40fb-bc23-33a5110937fa
322026-07-22T16:15:00.687ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55254, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b74c3c1b-853b-4b96-a953-8d565451a8d4."), ), original: Query { name: Name("oxz_cockroachdb_b74c3c1b-853b-4b96-a953-8d565451a8d4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 55, 52, 99, 51, 99, 49, 98, 45, 56, 53, 51, 98, 45, 52, 98, 57, 54, 45, 97, 57, 53, 51, 45, 56, 100, 53, 54, 53, 52, 53, 49, 97, 56, 100, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b74c3c1b-853b-4b96-a953-8d565451a8d4." peer_addr = [fd00:1122:3344:101::7]:62002 req_id = 7d70d811-245f-4430-8d08-e651bf348ff0
332026-07-22T16:15:00.787ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55150, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_e9ce096d-9e2f-4661-b53c-c15afb60686d."), ), original: Query { name: Name("oxz_ntp_e9ce096d-9e2f-4661-b53c-c15afb60686d."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 101, 57, 99, 101, 48, 57, 54, 100, 45, 57, 101, 50, 102, 45, 52, 54, 54, 49, 45, 98, 53, 51, 99, 45, 99, 49, 53, 97, 102, 98, 54, 48, 54, 56, 54, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_e9ce096d-9e2f-4661-b53c-c15afb60686d." peer_addr = [fd00:1122:3344:101::1b]:50709 req_id = 89eaa72b-4ae9-428f-bf29-bd14c7487c26
342026-07-22T16:15:01.101ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9435, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:60428 req_id = 264357d3-f9d0-4427-a091-e2c28976014a
352026-07-22T16:15:01.102ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 9435, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:35593 req_id = 5b7e30b1-daec-44c2-8714-048d64a1ca62