Max level shown:
1 [ Jul 2 01:13:05 Enabled. ]
2 [ Jul 2 01:13:05 Rereading configuration. ]
3 [ Jul 2 01:13:06 Rereading configuration. ]
4 [ Jul 2 01:13:07 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Jul 2 01:13:07 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-07-02T01:13:07.500ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-07-02T01:13:07.500ZINFOdns-server (store): opening sled database path = /data/dns
102026-07-02T01:13:07.520ZINFOdns-server (store): pruning trees for generations newer than 0
112026-07-02T01:13:07.520ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-07-02T01:13:07.520ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-07-02T01:13:07.521ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-07-02T01:13:07.602ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16887, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nexus._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 6, 95, 110, 101, 120, 117, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nexus._tcp.control-plane.oxide.internal." peer_addr = [fd00:1122:3344:3::2]:65376 req_id = fd3adf65-70d9-4d77-bb61-e39acc8ec022
152026-07-02T01:13:08.027ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:36987
162026-07-02T01:13:08.028ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 091852c1-a485-4238-8d39-b0a4726e84c2
172026-07-02T01:13:08.028ZINFOdns-server (store): pruning trees for generations newer than 0
182026-07-02T01:13:08.051ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
192026-07-02T01:13:08.051ZINFOdns-server (store): updated generation new_generation = 1 req_id = 091852c1-a485-4238-8d39-b0a4726e84c2
202026-07-02T01:13:08.051ZINFOdns-server (http): request completed latency_us = 22725 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:36987 req_id = 091852c1-a485-4238-8d39-b0a4726e84c2 response_code = 204 uri = /config
212026-07-02T01:13:20.936ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38709, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:43212 req_id = bf6b73f2-76e6-4a20-aaa0-09e98c50e663
222026-07-02T01:13:20.942ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34423, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:35943 req_id = 5ab2e311-3980-408b-9e76-6e44b08a0b07
232026-07-02T01:13:20.946ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 26417, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:33255 req_id = 7b00dd6e-8624-48ef-b829-adf5dde394c9
242026-07-02T01:15:00.540ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 24558, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_bb982893-1b69-4676-82d2-525a87fbda11."), ), original: Query { name: Name("oxz_ntp_bb982893-1b69-4676-82d2-525a87fbda11."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 98, 98, 57, 56, 50, 56, 57, 51, 45, 49, 98, 54, 57, 45, 52, 54, 55, 54, 45, 56, 50, 100, 50, 45, 53, 50, 53, 97, 56, 55, 102, 98, 100, 97, 49, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_bb982893-1b69-4676-82d2-525a87fbda11." peer_addr = [fd00:1122:3344:101::1b]:35333 req_id = 61987d69-b2e8-4f0a-918c-52d703de4db3
252026-07-02T01:15:00.656ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32410, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a783828c-6ee8-4d36-8573-c00b54eaa393."), ), original: Query { name: Name("oxz_cockroachdb_a783828c-6ee8-4d36-8573-c00b54eaa393."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 55, 56, 51, 56, 50, 56, 99, 45, 54, 101, 101, 56, 45, 52, 100, 51, 54, 45, 56, 53, 55, 51, 45, 99, 48, 48, 98, 53, 52, 101, 97, 97, 51, 57, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a783828c-6ee8-4d36-8573-c00b54eaa393." peer_addr = [fd00:1122:3344:101::7]:43583 req_id = 13152dfe-9489-4627-a7a0-c717e148a575
262026-07-02T01:15:00.656ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 32410, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a783828c-6ee8-4d36-8573-c00b54eaa393."), ), original: Query { name: Name("oxz_cockroachdb_a783828c-6ee8-4d36-8573-c00b54eaa393."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 55, 56, 51, 56, 50, 56, 99, 45, 54, 101, 101, 56, 45, 52, 100, 51, 54, 45, 56, 53, 55, 51, 45, 99, 48, 48, 98, 53, 52, 101, 97, 97, 51, 57, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a783828c-6ee8-4d36-8573-c00b54eaa393." peer_addr = [fd00:1122:3344:101::7]:57703 req_id = 3bce9eb5-b10f-40b3-b16d-c3c8a88866ea
272026-07-02T01:15:00.690ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 15520, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_940ebbcf-8510-4e92-ac63-cc05543270e4."), ), original: Query { name: Name("oxz_cockroachdb_940ebbcf-8510-4e92-ac63-cc05543270e4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 52, 48, 101, 98, 98, 99, 102, 45, 56, 53, 49, 48, 45, 52, 101, 57, 50, 45, 97, 99, 54, 51, 45, 99, 99, 48, 53, 53, 52, 51, 50, 55, 48, 101, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_940ebbcf-8510-4e92-ac63-cc05543270e4." peer_addr = [fd00:1122:3344:101::3]:33857 req_id = 84441f28-1387-47be-afee-e2d63a983acc
282026-07-02T01:15:00.690ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 15520, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_940ebbcf-8510-4e92-ac63-cc05543270e4."), ), original: Query { name: Name("oxz_cockroachdb_940ebbcf-8510-4e92-ac63-cc05543270e4."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 52, 48, 101, 98, 98, 99, 102, 45, 56, 53, 49, 48, 45, 52, 101, 57, 50, 45, 97, 99, 54, 51, 45, 99, 99, 48, 53, 53, 52, 51, 50, 55, 48, 101, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_940ebbcf-8510-4e92-ac63-cc05543270e4." peer_addr = [fd00:1122:3344:101::3]:40607 req_id = 69bc0984-c08b-4da0-987a-35fa920b6422
292026-07-02T01:15:00.726ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10501, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:33047 req_id = 3b5d8953-f9b7-49f0-9e68-00550060a818
302026-07-02T01:15:00.727ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10501, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:49819 req_id = bdf87ab7-0630-4d28-aa96-f505f3e5a7fc
312026-07-02T01:15:00.749ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30286, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7fd44c1f-c142-4ff1-9ba2-9fd6784af940."), ), original: Query { name: Name("oxz_cockroachdb_7fd44c1f-c142-4ff1-9ba2-9fd6784af940."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 102, 100, 52, 52, 99, 49, 102, 45, 99, 49, 52, 50, 45, 52, 102, 102, 49, 45, 57, 98, 97, 50, 45, 57, 102, 100, 54, 55, 56, 52, 97, 102, 57, 52, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7fd44c1f-c142-4ff1-9ba2-9fd6784af940." peer_addr = [fd00:1122:3344:101::5]:65410 req_id = 9c906cbf-6194-410b-9a7a-944df10fc8e1
322026-07-02T01:15:00.750ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 30286, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_7fd44c1f-c142-4ff1-9ba2-9fd6784af940."), ), original: Query { name: Name("oxz_cockroachdb_7fd44c1f-c142-4ff1-9ba2-9fd6784af940."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 55, 102, 100, 52, 52, 99, 49, 102, 45, 99, 49, 52, 50, 45, 52, 102, 102, 49, 45, 57, 98, 97, 50, 45, 57, 102, 100, 54, 55, 56, 52, 97, 102, 57, 52, 48, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_7fd44c1f-c142-4ff1-9ba2-9fd6784af940." peer_addr = [fd00:1122:3344:101::5]:37049 req_id = e52ce925-cb2e-45f5-ae00-c7958b8edade