Max level shown:
1 [ Sep 4 17:59:04 Enabled. ]
2 [ Sep 4 17:59:04 Rereading configuration. ]
3 [ Sep 4 17:59:05 Rereading configuration. ]
4 [ Sep 4 17:59:06 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:2::1]:5353 --dns-address [fd00:1122:3344:2::1]:53 &"). ]
5 [ Sep 4 17:59:06 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-09-04T17:59:06.725ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:2::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:2::1]:53 }
92026-09-04T17:59:06.725ZINFOdns-server (store): opening sled database path = /data/dns
102026-09-04T17:59:06.747ZINFOdns-server (store): pruning trees for generations newer than 0
112026-09-04T17:59:06.747ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-09-04T17:59:06.747ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:2::1]:53
132026-09-04T17:59:06.747ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:2::1]:5353
142026-09-04T17:59:07.849ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:2::1]:5353 remote_addr = [fd00:1122:3344:2::2]:35507
152026-09-04T17:59:07.850ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = b01a1a32-732e-438f-ab37-a39d4441a2c6
162026-09-04T17:59:07.850ZINFOdns-server (store): pruning trees for generations newer than 0
172026-09-04T17:59:07.877ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-09-04T17:59:07.878ZINFOdns-server (store): updated generation new_generation = 1 req_id = b01a1a32-732e-438f-ab37-a39d4441a2c6
192026-09-04T17:59:07.878ZINFOdns-server (http): request completed latency_us = 27965 local_addr = [fd00:1122:3344:2::1]:5353 method = PUT remote_addr = [fd00:1122:3344:2::2]:35507 req_id = b01a1a32-732e-438f-ab37-a39d4441a2c6 response_code = 204 uri = /config
202026-09-04T17:59:19.550ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 51540, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:50031 req_id = bc21c53f-9c5e-4ef1-9b84-ba13a71fe033
212026-09-04T17:59:19.555ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 45806, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:41504 req_id = dc16e229-65df-4d5e-b5e5-52043800365e
222026-09-04T17:59:19.560ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 13067, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59864 req_id = b64ebe55-13fe-40fd-8efa-e8a2849e3e25
232026-09-04T18:00:00.146ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22131, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3a40828e-cc5d-4c80-9702-ab763d58b2dd."), ), original: Query { name: Name("oxz_cockroachdb_3a40828e-cc5d-4c80-9702-ab763d58b2dd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 97, 52, 48, 56, 50, 56, 101, 45, 99, 99, 53, 100, 45, 52, 99, 56, 48, 45, 57, 55, 48, 50, 45, 97, 98, 55, 54, 51, 100, 53, 56, 98, 50, 100, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3a40828e-cc5d-4c80-9702-ab763d58b2dd." peer_addr = [fd00:1122:3344:101::5]:50288 req_id = 6dbb1794-d280-4a54-8239-99d5065a1164
242026-09-04T18:00:00.146ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 22131, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_3a40828e-cc5d-4c80-9702-ab763d58b2dd."), ), original: Query { name: Name("oxz_cockroachdb_3a40828e-cc5d-4c80-9702-ab763d58b2dd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 51, 97, 52, 48, 56, 50, 56, 101, 45, 99, 99, 53, 100, 45, 52, 99, 56, 48, 45, 57, 55, 48, 50, 45, 97, 98, 55, 54, 51, 100, 53, 56, 98, 50, 100, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_3a40828e-cc5d-4c80-9702-ab763d58b2dd." peer_addr = [fd00:1122:3344:101::5]:51131 req_id = 94dd7702-0613-4618-bbfc-d8f83ca09986
252026-09-04T18:00:00.173ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12182, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_90f2a8a6-7cda-4bec-917d-bacb3ac062db."), ), original: Query { name: Name("oxz_cockroachdb_90f2a8a6-7cda-4bec-917d-bacb3ac062db."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 48, 102, 50, 97, 56, 97, 54, 45, 55, 99, 100, 97, 45, 52, 98, 101, 99, 45, 57, 49, 55, 100, 45, 98, 97, 99, 98, 51, 97, 99, 48, 54, 50, 100, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_90f2a8a6-7cda-4bec-917d-bacb3ac062db." peer_addr = [fd00:1122:3344:101::7]:49604 req_id = 393dd0a5-ca74-413f-892d-af7d39c84574
262026-09-04T18:00:00.173ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12182, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_90f2a8a6-7cda-4bec-917d-bacb3ac062db."), ), original: Query { name: Name("oxz_cockroachdb_90f2a8a6-7cda-4bec-917d-bacb3ac062db."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 57, 48, 102, 50, 97, 56, 97, 54, 45, 55, 99, 100, 97, 45, 52, 98, 101, 99, 45, 57, 49, 55, 100, 45, 98, 97, 99, 98, 51, 97, 99, 48, 54, 50, 100, 98, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_90f2a8a6-7cda-4bec-917d-bacb3ac062db." peer_addr = [fd00:1122:3344:101::7]:58473 req_id = 067f05a7-d6d3-4fe6-a541-e7bf99a1d709
272026-09-04T18:00:00.194ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16250, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2416ec33-e8fa-46b2-b675-3cb563d3f3bd."), ), original: Query { name: Name("oxz_cockroachdb_2416ec33-e8fa-46b2-b675-3cb563d3f3bd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 52, 49, 54, 101, 99, 51, 51, 45, 101, 56, 102, 97, 45, 52, 54, 98, 50, 45, 98, 54, 55, 53, 45, 51, 99, 98, 53, 54, 51, 100, 51, 102, 51, 98, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2416ec33-e8fa-46b2-b675-3cb563d3f3bd." peer_addr = [fd00:1122:3344:101::6]:55891 req_id = c4355013-00b2-429d-9e96-61f0519bde9b
282026-09-04T18:00:00.195ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 16250, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_2416ec33-e8fa-46b2-b675-3cb563d3f3bd."), ), original: Query { name: Name("oxz_cockroachdb_2416ec33-e8fa-46b2-b675-3cb563d3f3bd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 50, 52, 49, 54, 101, 99, 51, 51, 45, 101, 56, 102, 97, 45, 52, 54, 98, 50, 45, 98, 54, 55, 53, 45, 51, 99, 98, 53, 54, 51, 100, 51, 102, 51, 98, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_2416ec33-e8fa-46b2-b675-3cb563d3f3bd." peer_addr = [fd00:1122:3344:101::6]:38622 req_id = 30d4092d-c7ef-447d-bf02-a5614c218703
292026-09-04T18:00:00.505ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33319, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:48103 req_id = 5f770223-e4f8-4fb6-a58e-ff5463c1b0c1
302026-09-04T18:00:00.506ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 33319, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:56703 req_id = 571eac89-cb86-4494-a239-4680094826af
312026-09-04T18:00:00.668ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18492, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_fa0ee406-ad96-4f6f-b667-2adb25f1743e."), ), original: Query { name: Name("oxz_ntp_fa0ee406-ad96-4f6f-b667-2adb25f1743e."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 102, 97, 48, 101, 101, 52, 48, 54, 45, 97, 100, 57, 54, 45, 52, 102, 54, 102, 45, 98, 54, 54, 55, 45, 50, 97, 100, 98, 50, 53, 102, 49, 55, 52, 51, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_fa0ee406-ad96-4f6f-b667-2adb25f1743e." peer_addr = [fd00:1122:3344:101::1b]:54937 req_id = c86c5255-5b65-44b1-a96f-7a450ac29496
322026-09-04T18:00:00.904ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56588, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_886b3caf-6297-453a-8448-3b22af11c7dd."), ), original: Query { name: Name("oxz_cockroachdb_886b3caf-6297-453a-8448-3b22af11c7dd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 54, 98, 51, 99, 97, 102, 45, 54, 50, 57, 55, 45, 52, 53, 51, 97, 45, 56, 52, 52, 56, 45, 51, 98, 50, 50, 97, 102, 49, 49, 99, 55, 100, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_886b3caf-6297-453a-8448-3b22af11c7dd." peer_addr = [fd00:1122:3344:101::4]:40895 req_id = df3c25d5-d517-46f9-abe5-178f5d053377
332026-09-04T18:00:00.905ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 56588, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_886b3caf-6297-453a-8448-3b22af11c7dd."), ), original: Query { name: Name("oxz_cockroachdb_886b3caf-6297-453a-8448-3b22af11c7dd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 56, 56, 54, 98, 51, 99, 97, 102, 45, 54, 50, 57, 55, 45, 52, 53, 51, 97, 45, 56, 52, 52, 56, 45, 51, 98, 50, 50, 97, 102, 49, 49, 99, 55, 100, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_886b3caf-6297-453a-8448-3b22af11c7dd." peer_addr = [fd00:1122:3344:101::4]:47528 req_id = c916d9af-c1be-427e-aa9e-e921f63f6fe0
342026-09-04T18:00:00.958ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40359, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e4fdd0d4-49aa-44e6-96d4-9a868d761099."), ), original: Query { name: Name("oxz_cockroachdb_e4fdd0d4-49aa-44e6-96d4-9a868d761099."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 52, 102, 100, 100, 48, 100, 52, 45, 52, 57, 97, 97, 45, 52, 52, 101, 54, 45, 57, 54, 100, 52, 45, 57, 97, 56, 54, 56, 100, 55, 54, 49, 48, 57, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e4fdd0d4-49aa-44e6-96d4-9a868d761099." peer_addr = [fd00:1122:3344:101::3]:49097 req_id = c8e41d54-9717-40e7-954e-d42a66127333
352026-09-04T18:00:00.958ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40359, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_e4fdd0d4-49aa-44e6-96d4-9a868d761099."), ), original: Query { name: Name("oxz_cockroachdb_e4fdd0d4-49aa-44e6-96d4-9a868d761099."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 101, 52, 102, 100, 100, 48, 100, 52, 45, 52, 57, 97, 97, 45, 52, 52, 101, 54, 45, 57, 54, 100, 52, 45, 57, 97, 56, 54, 56, 100, 55, 54, 49, 48, 57, 57, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_e4fdd0d4-49aa-44e6-96d4-9a868d761099." peer_addr = [fd00:1122:3344:101::3]:33423 req_id = af4d089d-d4b4-4e0a-93a1-fdfa80db2528