Max level shown:
1 [ Jun 29 20:28:35 Enabled. ]
2 [ Jun 29 20:28:35 Rereading configuration. ]
3 [ Jun 29 20:28:35 Rereading configuration. ]
4 [ Jun 29 20:28:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/site/internal_dns/config.toml --http-address [fd00:1122:3344:3::1]:5353 --dns-address [fd00:1122:3344:3::1]:53 &"). ]
5 [ Jun 29 20:28:37 Method "start" exited with status 0. ]
6 Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } }
7 note: configured to log to "/dev/stdout"
82026-06-29T20:28:37.392ZINFOdns-server: config config = Config { log: File { level: Info, path: "/dev/stdout", if_exists: Append }, dropshot: ConfigDropshot { bind_address: [fd00:1122:3344:3::1]:5353, default_request_body_max_bytes: 104857600, default_handler_task_mode: Detached, log_headers: [], compression: None }, storage: Config { storage_path: "/data/dns", keep_old_generations: 3 } } dns_config = Config { bind_address: [fd00:1122:3344:3::1]:53 }
92026-06-29T20:28:37.392ZINFOdns-server (store): opening sled database path = /data/dns
102026-06-29T20:28:37.413ZINFOdns-server (store): pruning trees for generations newer than 0
112026-06-29T20:28:37.413ZINFOdns-server (store): pruning trees for generations older than 0 keep = 3
122026-06-29T20:28:37.413ZINFOdns-server (dns): DNS server bound to address local_address = [fd00:1122:3344:3::1]:53
132026-06-29T20:28:37.413ZINFOdns-server (http): listening local_addr = [fd00:1122:3344:3::1]:5353
142026-06-29T20:28:37.503ZINFOdns-server (http): accepted connection local_addr = [fd00:1122:3344:3::1]:5353 remote_addr = [fd00:1122:3344:3::2]:40615
152026-06-29T20:28:37.504ZINFOdns-server (store): attempting generation update new_generation = 1 req_id = 89dbbe55-5329-4c54-be16-3f11eb4a58fe
162026-06-29T20:28:37.504ZINFOdns-server (store): pruning trees for generations newer than 0
172026-06-29T20:28:37.535ZINFOdns-server (store): pruning trees for generations older than 1 keep = 3
182026-06-29T20:28:37.535ZINFOdns-server (store): updated generation new_generation = 1 req_id = 89dbbe55-5329-4c54-be16-3f11eb4a58fe
192026-06-29T20:28:37.535ZINFOdns-server (http): request completed latency_us = 31818 local_addr = [fd00:1122:3344:3::1]:5353 method = PUT remote_addr = [fd00:1122:3344:3::2]:40615 req_id = 89dbbe55-5329-4c54-be16-3f11eb4a58fe response_code = 204 uri = /config
202026-06-29T20:28:52.881ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 38083, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:33718 req_id = d1a2887d-e807-454e-a474-40be79c0f74f
212026-06-29T20:28:52.886ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 7463, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: AAAA, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 28, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:52103 req_id = 41e14a33-5215-41fd-af12-763204b8748c
222026-06-29T20:28:52.890ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59916, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("0.pool.ntp.org."), ), original: Query { name: Name("0.pool.ntp.org."), query_type: A, query_class: IN, }, }, ], original: [ 1, 48, 4, 112, 111, 111, 108, 3, 110, 116, 112, 3, 111, 114, 103, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "0.pool.ntp.org." peer_addr = [fd00:1122:3344:101::1b]:59653 req_id = 8526ce15-6570-4a22-836a-2a48df7fe12f
232026-06-29T20:30:01.017ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34664, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:38195 req_id = a9e8396f-bb06-4047-ab8b-ebd13030adb1
242026-06-29T20:30:01.019ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 34664, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_switch."), ), original: Query { name: Name("oxz_switch."), query_type: A, query_class: IN, }, }, ], original: [ 10, 111, 120, 122, 95, 115, 119, 105, 116, 99, 104, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_switch." peer_addr = [fd00:1122:3344:101::2]:36577 req_id = 27a7cacb-6eef-47c5-bb39-5a74b5d0e22b
252026-06-29T20:30:01.026ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18510, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_53a29c57-314e-43ee-9761-8b173e0a20cd."), ), original: Query { name: Name("oxz_cockroachdb_53a29c57-314e-43ee-9761-8b173e0a20cd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 51, 97, 50, 57, 99, 53, 55, 45, 51, 49, 52, 101, 45, 52, 51, 101, 101, 45, 57, 55, 54, 49, 45, 56, 98, 49, 55, 51, 101, 48, 97, 50, 48, 99, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_53a29c57-314e-43ee-9761-8b173e0a20cd." peer_addr = [fd00:1122:3344:101::5]:39549 req_id = 8ebf097c-0d10-40d0-9cdf-65cf018fa5b7
262026-06-29T20:30:01.027ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35769, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_434ca37b-4810-4e24-bad3-0dee6bbc1ff1."), ), original: Query { name: Name("oxz_cockroachdb_434ca37b-4810-4e24-bad3-0dee6bbc1ff1."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 51, 52, 99, 97, 51, 55, 98, 45, 52, 56, 49, 48, 45, 52, 101, 50, 52, 45, 98, 97, 100, 51, 45, 48, 100, 101, 101, 54, 98, 98, 99, 49, 102, 102, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_434ca37b-4810-4e24-bad3-0dee6bbc1ff1." peer_addr = [fd00:1122:3344:101::4]:52597 req_id = d3aa863c-ce7e-4a20-afdf-7584ab886d6d
272026-06-29T20:30:01.027ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42309, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ce4b0da8-505a-4b9b-86c9-43f582517924."), ), original: Query { name: Name("oxz_cockroachdb_ce4b0da8-505a-4b9b-86c9-43f582517924."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 101, 52, 98, 48, 100, 97, 56, 45, 53, 48, 53, 97, 45, 52, 98, 57, 98, 45, 56, 54, 99, 57, 45, 52, 51, 102, 53, 56, 50, 53, 49, 55, 57, 50, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ce4b0da8-505a-4b9b-86c9-43f582517924." peer_addr = [fd00:1122:3344:101::6]:63565 req_id = 0c5b639b-ed5c-4a77-bbe0-1c2dcfa01668
282026-06-29T20:30:01.027ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 18510, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_53a29c57-314e-43ee-9761-8b173e0a20cd."), ), original: Query { name: Name("oxz_cockroachdb_53a29c57-314e-43ee-9761-8b173e0a20cd."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 53, 51, 97, 50, 57, 99, 53, 55, 45, 51, 49, 52, 101, 45, 52, 51, 101, 101, 45, 57, 55, 54, 49, 45, 56, 98, 49, 55, 51, 101, 48, 97, 50, 48, 99, 100, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_53a29c57-314e-43ee-9761-8b173e0a20cd." peer_addr = [fd00:1122:3344:101::5]:61214 req_id = de79c4ef-7062-46aa-91a7-9ae982c9cbfb
292026-06-29T20:30:01.027ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 35769, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_434ca37b-4810-4e24-bad3-0dee6bbc1ff1."), ), original: Query { name: Name("oxz_cockroachdb_434ca37b-4810-4e24-bad3-0dee6bbc1ff1."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 51, 52, 99, 97, 51, 55, 98, 45, 52, 56, 49, 48, 45, 52, 101, 50, 52, 45, 98, 97, 100, 51, 45, 48, 100, 101, 101, 54, 98, 98, 99, 49, 102, 102, 49, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_434ca37b-4810-4e24-bad3-0dee6bbc1ff1." peer_addr = [fd00:1122:3344:101::4]:64048 req_id = bc5c263a-42a3-432f-bea8-849d55eca5cf
302026-06-29T20:30:01.027ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 42309, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_ce4b0da8-505a-4b9b-86c9-43f582517924."), ), original: Query { name: Name("oxz_cockroachdb_ce4b0da8-505a-4b9b-86c9-43f582517924."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 99, 101, 52, 98, 48, 100, 97, 56, 45, 53, 48, 53, 97, 45, 52, 98, 57, 98, 45, 56, 54, 99, 57, 45, 52, 51, 102, 53, 56, 50, 53, 49, 55, 57, 50, 52, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_ce4b0da8-505a-4b9b-86c9-43f582517924." peer_addr = [fd00:1122:3344:101::6]:57905 req_id = 2848d4e9-f55f-4c05-8f84-cf108e015ba9
312026-06-29T20:30:01.027ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40127, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f7a725f8-f864-4cbc-bee9-9f516861f63e."), ), original: Query { name: Name("oxz_cockroachdb_f7a725f8-f864-4cbc-bee9-9f516861f63e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 55, 97, 55, 50, 53, 102, 56, 45, 102, 56, 54, 52, 45, 52, 99, 98, 99, 45, 98, 101, 101, 57, 45, 57, 102, 53, 49, 54, 56, 54, 49, 102, 54, 51, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f7a725f8-f864-4cbc-bee9-9f516861f63e." peer_addr = [fd00:1122:3344:101::7]:49219 req_id = d72452bc-172b-423e-ad45-91c818b2a33b
322026-06-29T20:30:01.028ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 40127, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_f7a725f8-f864-4cbc-bee9-9f516861f63e."), ), original: Query { name: Name("oxz_cockroachdb_f7a725f8-f864-4cbc-bee9-9f516861f63e."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 102, 55, 97, 55, 50, 53, 102, 56, 45, 102, 56, 54, 52, 45, 52, 99, 98, 99, 45, 98, 101, 101, 57, 45, 57, 102, 53, 49, 54, 56, 54, 49, 102, 54, 51, 101, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_f7a725f8-f864-4cbc-bee9-9f516861f63e." peer_addr = [fd00:1122:3344:101::7]:38694 req_id = 3a2a3444-9f16-424b-9493-d44ca3a57839
332026-06-29T20:30:01.028ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37034, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_ntp_711d056a-72ae-4e3b-805e-c14f32720308."), ), original: Query { name: Name("oxz_ntp_711d056a-72ae-4e3b-805e-c14f32720308."), query_type: A, query_class: IN, }, }, ], original: [ 44, 111, 120, 122, 95, 110, 116, 112, 95, 55, 49, 49, 100, 48, 53, 54, 97, 45, 55, 50, 97, 101, 45, 52, 101, 51, 98, 45, 56, 48, 53, 101, 45, 99, 49, 52, 102, 51, 50, 55, 50, 48, 51, 48, 56, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_ntp_711d056a-72ae-4e3b-805e-c14f32720308." peer_addr = [fd00:1122:3344:101::1b]:56585 req_id = a7ad0a4c-61f2-455f-8b6e-d8b68726bdf6
342026-06-29T20:30:01.033ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_43e348c5-af49-402b-9fde-4e74794d4f97."), ), original: Query { name: Name("oxz_cockroachdb_43e348c5-af49-402b-9fde-4e74794d4f97."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 51, 101, 51, 52, 56, 99, 53, 45, 97, 102, 52, 57, 45, 52, 48, 50, 98, 45, 57, 102, 100, 101, 45, 52, 101, 55, 52, 55, 57, 52, 100, 52, 102, 57, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_43e348c5-af49-402b-9fde-4e74794d4f97." peer_addr = [fd00:1122:3344:101::3]:45058 req_id = 13533d41-a172-4a35-a5db-db99472bbc98
352026-06-29T20:30:01.034ZERROdns-server (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41645, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 0, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("oxz_cockroachdb_43e348c5-af49-402b-9fde-4e74794d4f97."), ), original: Query { name: Name("oxz_cockroachdb_43e348c5-af49-402b-9fde-4e74794d4f97."), query_type: A, query_class: IN, }, }, ], original: [ 52, 111, 120, 122, 95, 99, 111, 99, 107, 114, 111, 97, 99, 104, 100, 98, 95, 52, 51, 101, 51, 52, 56, 99, 53, 45, 97, 102, 52, 57, 45, 52, 48, 50, 98, 45, 57, 102, 100, 101, 45, 52, 101, 55, 52, 55, 57, 52, 100, 52, 102, 57, 55, 0, 0, 1, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: None, } SERVFAIL: server is not authoritative for name: "oxz_cockroachdb_43e348c5-af49-402b-9fde-4e74794d4f97." peer_addr = [fd00:1122:3344:101::3]:55120 req_id = 037bcdf6-3800-447a-b52f-9fb57a2b3a4e