Max level shown:
1 [ Sep 7 00:41:37 Enabled. ]
2 [ Sep 7 00:41:37 Rereading configuration. ]
3 [ Sep 7 00:41:37 Rereading configuration. ]
4 [ Sep 7 00:41:38 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Sep 7 00:41:38 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-09-07T00:41:38.661ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-09-07T00:41:38.661ZINFOdns-server (store): opening sled database path = /data/dns
102026-09-07T00:41:38.679ZINFOdns-server (store): pruning trees for generations newer than 0
112026-09-07T00:41:38.679ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-09-07T00:41:38.679ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-09-07T00:41:38.679ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-09-07T00:41:39.770ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:50860
152026-09-07T00:41:39.771ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 730d6a29-97aa-4059-a931-dcfcb952a5b6
162026-09-07T00:41:39.771ZINFOdns-server (store): pruning trees for generations newer than 0
172026-09-07T00:41:39.783ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-09-07T00:41:39.783ZINFOdns-server (store): updated generation new_generation = 1 req_id = 730d6a29-97aa-4059-a931-dcfcb952a5b6
192026-09-07T00:41:39.783ZINFOdns-server (http): request completed latency_us = 13131 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:50860 req_id = 730d6a29-97aa-4059-a931-dcfcb952a5b6 response_code = 204 uri = /config
202026-09-07T00:41:50.463ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 48781, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:48765 req_id = 050b8178-ef1c-4c01-87ae-0d977fe75731
212026-09-07T00:41:50.468ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 55449, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:61276 req_id = 6886674f-37c4-4954-a4f6-a33839d7b27c
222026-09-07T00:41:50.472ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 61856, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:47632 req_id = 23e4f45a-2148-46c2-8fee-248fb989ed56
232026-09-07T00:45:00.901ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1756, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a2b685ab-2aef-4889-bb3c-bac1bc056177."), ), original: Query { name: Name("oxz_cockroachdb_a2b685ab-2aef-4889-bb3c-bac1bc056177."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 50, 98, 54, 56, 53, 97, 98, 45, 50, 97, 101, 102, 45, 52, 56, 56, 57, 45, 98, 98, 51, 99, 45, 98, 97, 99, 49, 98, 99, 48, 53, 54, 49, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a2b685ab-2aef-4889-bb3c-bac1bc056177." peer_addr = [fd00:1122:3344:101::4]:36452 req_id = 863d18eb-71c2-4e33-b7a5-f4a7b1408d1f
242026-09-07T00:45:00.902ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1756, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_a2b685ab-2aef-4889-bb3c-bac1bc056177."), ), original: Query { name: Name("oxz_cockroachdb_a2b685ab-2aef-4889-bb3c-bac1bc056177."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 97, 50, 98, 54, 56, 53, 97, 98, 45, 50, 97, 101, 102, 45, 52, 56, 56, 57, 45, 98, 98, 51, 99, 45, 98, 97, 99, 49, 98, 99, 48, 53, 54, 49, 55, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_a2b685ab-2aef-4889-bb3c-bac1bc056177." peer_addr = [fd00:1122:3344:101::4]:54884 req_id = fb0c29cc-eb7d-45f3-bb25-531f88df1378
252026-09-07T00:45:00.903ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52383, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_60d12c08-8f21-4a13-88b2-66a4781238a3."), ), original: Query { name: Name("oxz_cockroachdb_60d12c08-8f21-4a13-88b2-66a4781238a3."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 54, 48, 100, 49, 50, 99, 48, 56, 45, 56, 102, 50, 49, 45, 52, 97, 49, 51, 45, 56, 56, 98, 50, 45, 54, 54, 97, 52, 55, 56, 49, 50, 51, 56, 97, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_60d12c08-8f21-4a13-88b2-66a4781238a3." peer_addr = [fd00:1122:3344:101::6]:34400 req_id = e86d70a6-6593-445a-b73d-d8a25312b2eb
262026-09-07T00:45:00.904ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52383, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_60d12c08-8f21-4a13-88b2-66a4781238a3."), ), original: Query { name: Name("oxz_cockroachdb_60d12c08-8f21-4a13-88b2-66a4781238a3."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 54, 48, 100, 49, 50, 99, 48, 56, 45, 56, 102, 50, 49, 45, 52, 97, 49, 51, 45, 56, 56, 98, 50, 45, 54, 54, 97, 52, 55, 56, 49, 50, 51, 56, 97, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_60d12c08-8f21-4a13-88b2-66a4781238a3." peer_addr = [fd00:1122:3344:101::6]:52523 req_id = 42f6012c-9601-4d9c-88f0-8ab3882e1bf6
272026-09-07T00:45:00.914ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13507, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b5947749-6449-49a8-b66b-dc2f0a45a923."), ), original: Query { name: Name("oxz_cockroachdb_b5947749-6449-49a8-b66b-dc2f0a45a923."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 53, 57, 52, 55, 55, 52, 57, 45, 54, 52, 52, 57, 45, 52, 57, 97, 56, 45, 98, 54, 54, 98, 45, 100, 99, 50, 102, 48, 97, 52, 53, 97, 57, 50, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b5947749-6449-49a8-b66b-dc2f0a45a923." peer_addr = [fd00:1122:3344:101::5]:34535 req_id = 38163462-90b5-44f9-a917-a44c5b7f0015
282026-09-07T00:45:00.914ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13507, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b5947749-6449-49a8-b66b-dc2f0a45a923."), ), original: Query { name: Name("oxz_cockroachdb_b5947749-6449-49a8-b66b-dc2f0a45a923."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 53, 57, 52, 55, 55, 52, 57, 45, 54, 52, 52, 57, 45, 52, 57, 97, 56, 45, 98, 54, 54, 98, 45, 100, 99, 50, 102, 48, 97, 52, 53, 97, 57, 50, 51, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b5947749-6449-49a8-b66b-dc2f0a45a923." peer_addr = [fd00:1122:3344:101::5]:59926 req_id = eb8c273c-0f63-4d5c-a91c-ed49c5099ed0
292026-09-07T00:45:00.949ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27634, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b33e4cf4-0f6f-4eee-9a0f-622a22ee141c."), ), original: Query { name: Name("oxz_cockroachdb_b33e4cf4-0f6f-4eee-9a0f-622a22ee141c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 51, 51, 101, 52, 99, 102, 52, 45, 48, 102, 54, 102, 45, 52, 101, 101, 101, 45, 57, 97, 48, 102, 45, 54, 50, 50, 97, 50, 50, 101, 101, 49, 52, 49, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b33e4cf4-0f6f-4eee-9a0f-622a22ee141c." peer_addr = [fd00:1122:3344:101::7]:46004 req_id = 532e5d59-f61c-4e9c-8227-c62c0fbb6e5d
302026-09-07T00:45:00.949ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 27634, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_b33e4cf4-0f6f-4eee-9a0f-622a22ee141c."), ), original: Query { name: Name("oxz_cockroachdb_b33e4cf4-0f6f-4eee-9a0f-622a22ee141c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 98, 51, 51, 101, 52, 99, 102, 52, 45, 48, 102, 54, 102, 45, 52, 101, 101, 101, 45, 57, 97, 48, 102, 45, 54, 50, 50, 97, 50, 50, 101, 101, 49, 52, 49, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_b33e4cf4-0f6f-4eee-9a0f-622a22ee141c." peer_addr = [fd00:1122:3344:101::7]:52544 req_id = 2bcd8a4e-d919-48e9-b353-70a5e929968c
312026-09-07T00:45:00.955ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 65518, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_7e9e3305-a23e-434f-ba9f-717a6e90028f."), ), original: Query { name: Name("oxz_ntp_7e9e3305-a23e-434f-ba9f-717a6e90028f."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 55, 101, 57, 101, 51, 51, 48, 53, 45, 97, 50, 51, 101, 45, 52, 51, 52, 102, 45, 98, 97, 57, 102, 45, 55, 49, 55, 97, 54, 101, 57, 48, 48, 50, 56, 102, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_7e9e3305-a23e-434f-ba9f-717a6e90028f." peer_addr = [fd00:1122:3344:101::1b]:41273 req_id = 3d5d1cb3-7973-4cee-838f-7f2942c476e9
322026-09-07T00:45:00.993ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8737, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ee324549-66b0-44b1-b37d-961d44cc889c."), ), original: Query { name: Name("oxz_cockroachdb_ee324549-66b0-44b1-b37d-961d44cc889c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 101, 51, 50, 52, 53, 52, 57, 45, 54, 54, 98, 48, 45, 52, 52, 98, 49, 45, 98, 51, 55, 100, 45, 57, 54, 49, 100, 52, 52, 99, 99, 56, 56, 57, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ee324549-66b0-44b1-b37d-961d44cc889c." peer_addr = [fd00:1122:3344:101::3]:55933 req_id = 5d4accc4-44d7-4eb2-9ae0-9b64151aef61
332026-09-07T00:45:00.993ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 8737, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ee324549-66b0-44b1-b37d-961d44cc889c."), ), original: Query { name: Name("oxz_cockroachdb_ee324549-66b0-44b1-b37d-961d44cc889c."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 101, 51, 50, 52, 53, 52, 57, 45, 54, 54, 98, 48, 45, 52, 52, 98, 49, 45, 98, 51, 55, 100, 45, 57, 54, 49, 100, 52, 52, 99, 99, 56, 56, 57, 99, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ee324549-66b0-44b1-b37d-961d44cc889c." peer_addr = [fd00:1122:3344:101::3]:47308 req_id = 0593c598-8889-474c-823e-7be825762266
342026-09-07T00:45:01.174ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25092, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:60195 req_id = 88a4e3c0-deeb-4816-9962-8e4ec911a439
352026-09-07T00:45:01.175ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 25092, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:43998 req_id = bf636fc3-c448-4c60-a7f6-121d85713983